J 



I 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




per 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 3 : 
G06K9/00 



Al 



(11) International Publication Number: 
(43) International Publication Date: 



WO 94/09447 

28 April 1994 (28.04.94) 



(21) International Application Number: PCT/US92/08703 

(22) International Filing Date: 13 October 1992 (13.10.92) 



(71X72) Applicants and Inventors: ORBACH, Zvi [IL/USJ; 331 
Creekside, Palo Alto, CA 94306 (US). BARON, Ehud 
[IL/IL]; 63 Haag Street, 34 980 Haifa (IL). 

(74) Agents: GALLOWAY, Peter, D. et al.; Ladas & Parry, 26 
West 61 Street, New York, NY 10023 (US). 



(81) Designated States: AT, AU, BB, BG, BR, CA, CH, CS, 
DE, DK, ES, FI, GB, HU, JP, KP, KR, KZ, LK, LU, 
MG, MN, MW, NL, NO, PL, RO, RU, SD, SE, UA, US, 
European patent (AT, BE, CH, DE, DK, ES, FR, GB, 
GR, IE, IT, LU, MC, NL, SE), OAPI patent (BF, BJ, 
CF, CG, CI, CM, GA, GN, ML, MR, SN, TD, TG). 



Published 

With international search report. 



(54) Title: APPARATUS FOR READING HANDWRITING 



(57) Abstract 

Apparatus for reading handwriting including apparatus (20) for sensing fea- 
tures of handwriting of an individual which features are highly characteristic of the 
individual but which also contain information relating to symbols being written and 
apparatus, which is configured for the individual, for providing a non-individual 
dependent output (26) indicating the symbols being written in response to the 
sensed features. 




FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international 
applications under the PCT. 



AT 


Austria 


AU 


Australia 


BB 


Barbados 


BE 


Belt» urn 


BF 


Burkina Faso 


BC 


Bulgaria 


BJ 


Benin 


BR 


Brazil 


BY 


Belarus 


CA 


Canada 


CF 


Central African Republic 


CG 


Congo 


CH 


Switzerland 


CI 


Cote d*l voire 


CM 


Cameroon 


CN 


China 


cs 


Czechoslovakia 


cz 


Czech Republic 


DB 


Germany 


DK 


Denmark 


BS 


Spain 


Fl 


Finland 



FR 


France 


GA 


Gabon 


GB 


United Kingdom 


GN 


Guinea 


CR 


Greece 


HU 


Hungary 


IE 


Ireland 


IT 


Italy 


JP 


Japan 


KF 


Democratic People's Republic 




of Korea 


ICR 


Republic of Korea 


KZ 


Kazakhstan 


U 


Liechtenstein 


UC 


Sri Lanka 


LU 


Luxembourg 


LV 


Laivla 


MC 


Monaco 


MC 


Madagascar 


ML 


Mali 


MN 


Mongolia 



MR 


Mauritania 


MW 


Malawi 


NE 


Niger 


NL 


Netherlands 


NO 


Norway 


NZ 


New Zealand 


PL 


Poland 


PT 


Portugal 


RO 


Romania 


RU 


Russian Federation 


SO 


Sudan 


SE 


Sweden 


SI 


Slovenia 


SK 


Slovak Republic 


SN 


Senegal 


TO 


Chad 


TC 


Togo 


UA 


Ukraine 


US 


United Slates of America 


uz 


Uzbekistan 


VN 


Vict Nam 



WO 94/09447 



PCT/US92/08703 



1 

APPARATUS FOR READING HANDWRITING 

1 
2 

3 FIELD OF THE INVENTION 

k The present invention relates to computer 

5 input devices generally and more particularly to 

6 handwriting responsive computer input devices. 
7 

8 BACKGROUND OF THE INVENTION 

9 

10 There exists a significant amount of activity 

11 in the field of on-line handwriting recognition. The 

12 prior art current to 1990 is reviewed in w The State of 

13 the Art in On-Line Handwriting Recognition" by Charles 

14 C. Tappert et al, IEEE Transactions on Pattern Analysis 

15 and Machine Intelligence, Vol. 12, No. 8 f August, 1990. 

16 Generally speaking, on-line handwriting 

17 analysis is currently employed for two distinct 

18 applications: identity verification and input of 

19 handwritten letters and numbers into a computer. These 

20 two applications have sharply contrasting operational 

21 requirements and goals. Handwriting analysis for 

22 identity verification senses features of handwriting 

23 which are distinct for each individual and thus can be 
2k used to unambiguously identify a given individual. In 

25 contrast, handwriting analysis for alphanumeric input 

26 to a computer seeks to minimize the effect of the very 

27 features which are important for identity verification 

28 and to concentrate on universal handwriting 

29 characteristics which can be associated with given 

30 symbols independently of the individual writer. 

31 Currently existing and proposed systems 

32 providing handwriting analysis for alphanumeric input 

33 to a computer are generally geared towards recognition 

34 of how a symbol looks rather than how it is created. 

35 Accordingly, such systems employ digitizers or graphic 

36 tablets. 

37 Signature verification systems, on the other 

38 hand, attempt to identify biometric characteristics of 
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1 the writer and employ indications such as pressure and 

2 acceleration during writing. 

3 U.S. Patent 4, 345. 239 employs pen 

4 acceleration for use in a signature verification 

5 system. U.S. Patent 5.054,088 employs both acceleration 

6 and pressure data characteristics of handwriting for 

7 identity verification. As indicated by the above 

8 patents, pen acceleration is employed for signature 

9 verification because it is a personal feature, 

10 characteristic of each individual. Accordingly, pen 

11 acceleration has not been employed for alphanumeric 

12 input. 

13 U.S. Patent 4,751,741 describes pen-type 

14 character 

15 recognition apparatus which employs pen pressure data 

16 exclusively. 
17 

18 

!9. 
20 
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3 

1 SUMMARY OF THE INVENTION 

2 

3 The present invention seeks to provide 

4 improved handwriting information input apparatus. 

5 There is thus provided in accordance with a 

6 preferred embodiment of the present invention apparatus 

7 for reading handwriting including apparatus for sensing 

8 features of handwriting of an individual which features 

9 are highly characteristic of the individual but which 

10 also contain information relating to symbols being 

11 written and apparatus, which is configured for the 

12 individual, for providing a non-individual dependent 

13 output indicating the symbols being written in response 

14 to the sensed features. 

15 In accordance with a preferred embodiment of 

16 the present invention .the apparatus for reading 

17 handwriting is contained in a hand-held housing. 

18 Preferably the apparatus for reading handwriting 

19 includes apparatus for wireless communication with a 

20 computer to which it inputs symbol data. 

21 In accordance with a preferred embodiment of 

22 the present invention, the apparatus for reading 

23 handwriting does not require a tablet. Additionally in 
2k accordance with a preferred embodiment of the 

25 invention, the apparatus for reading handwriting 

26 communicates with the keyboard input of a computer. 

27 Additionally in accordance with a preferred 

28 embodiment of the present invention there is provided 

29 apparatus for reading handwriting including 

30 personalized hand-held apparatus for sensing 

31 acceleration during handwriting and providing an output 

32 indication of handwriting content in a non-personalized 

33 form. 

3^ Further in accordance with a preferred 

35 embodiment of the present invention there is provided 

36 apparatus for reading handwriting including wireless 

37 hand-held apparatus for sensing handwriting and 

38 providing an output indication of the contents thereof. 
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1 Additionally in accordance with a preferred 

2 embodiment of the present invention there is provided 

3 apparatus for reading handwriting including personally 

4 trainable hand-held apparatus for sensing motion during 

5 handwriting and providing an output indication of 

6 handwriting content. 

7 Further in accordance with a preferred 

8 embodiment of the present invention there is provided 

9 apparatus for reading handwriting in real time 

10 comprising a hand held housing, a motion sensor 

11 disposed in the housing, recognizing apparatus disposed 

12 within the hosing and receiving signals from said 

13 motion sensor for sensing a plurality of handwriting 
Ik characteristics and symbol recognizing apparatus 

15 disposed in said housing receiving the outputs of the 

16 plurality of parallel recognizers for providing an 

17 indication of a handwritten symbol. 

18 Additionally in accordance with a preferred 

19 embodiment of the present invention there is provided 

20 apparatus for reading handwriting including hand-held 

21 apparatus for sensing motion during handwriting and 

22 providing an output indication of handwriting content 

23 in a form corresponding to that of a conventional 
2k keyboard . 

25 Further in accordance with a preferred 

26 embodiment of the present invention there is provided 

27 apparatus for reading handwriting including hand-held 

28 apparatus for sensing motion during handwriting and 

29 providing an output indication of handwriting content 

30 in a RS-232 compatible form. 

31 Additionally in accordance with a preferred 

32 embodiment of the present invention there is provided 

33 audio-visual apparatus including apparatus for 

34 providing a human sensible output including information 

35 in at least one of audio and visual form and having as 

36 an input element hand-held apparatus for sensing motion 

37 during handwriting of the type described hereinabove. 

38 Examples of such audio-visual apparatus 



WO 94/09447 



PCIYUS92/08703 



5 

1 include a video recorder and player, a stereo audio 

2 player and a television. 

3 Further in accordance with a preferred 

4 embodiment of the present invention there is provided 

5 portable information storage and retrieval apparatus 

6 including a portable computer memory and output device 

7 and having as an input element hand-held apparatus for 

8 sensing motion during handwriting of the type described 

9 hereinabove. 

10 Examples of such portable information storage 

11 and retrieval apparatus include a digital watch with 

12 memory, a computerized diary, a computerized dictionary 

13 and electronic telephone book. 

14 Additionally in accordance with a preferred 

15 embodiment of the present invention there is provided 

16 lock apparatus including locking apparatus responsive 

17 to a predetermined electronic input and having as an 

18 input element hand-held apparatus for sensing motion 

19 during handwriting of the type described hereinabove. 

20 Examples of such locking apparatus include 

21 door locks and vehicle door locks and ignitions. 

22 Further in accordance with a preferred 

23 embodiment of the present invention there is provided 
2k magnetic card activated apparatus including apparatus 

25 for reading a magnetic card and having as a 

26 verification input element, hand-held apparatus for 

27 sensing motion during handwriting of the type described 

28 hereinabove. 

29 Examples of such magnetic card activated 

30 apparatus include automatic teller apparatus and point 

31 of sales credit card acceptance units. 

32 Various combinations of the above-mentioned 

33 structural and functional elements alone or in 
3^ combination with additional elements, such as, for 

35 example, graphical input capabilities, are also within 

36 the scope of the present invention. 
37 

38 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 The present invention will be understood and 

3 appreciated more fully from the following detailed 
k description, taken in conjunction with the drawings in 

5 which: 

6 Fig. 1 is a pictorial illustration of a 

7 handwriting reading device constructed and operative in 

8 accordance with a preferred embodiment of the present 

9 invention in an operative environment; 

10 Fig. 2 is a simplified illustration of a 

11 preferred mechanical structure of the handwriting 

12 reading device of the present invention; 

13 Fig. 3 is a simplified block diagram 
lk illustration of the handwriting reading device of Figs. 

15 2 and 3; 

16 Fig. 4 is a partially schematic, partially 

17 block diagram illustration of part of the apparatus of 

18 Fig. 3; 

19 Fig. 5 is a block diagram illustration of 

20 part of the apparatus of Fig. k; and 

21 Figs. 6A and 6B are simplified flow charts 

22 illustrating operation of the handwriting reading 

23 device of Figs. 3 " 5 during handwriting reading. Fig. 
2k 6B illustrates the teaching process and Fig. 6B 
25 illustrates the recognition process. 

26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
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1 DETAILED DESCRIPTION OF A- PREFERRED EMBODIMENT 

2 It has been found by the present inventor 

3 that each writer produces conventional alphanumeric 

4 characters from pen strokes selected from a set 

5 containing approximately 12 - 14 pen strokes, which set 

6 is characteristic of each individual. The present 

7 invention employs this realization to provide a 

8 personalizable handwriting input device. Appendix A 

9 contains a detailed exposition of the finding of the 
10 inventor . 

11 

12 Reference is now made to Fig, 1, which 

13 illustrates a handwriting input device 10 constructed 

14 and operative in accordance with a preferred embodiment 

15 of the invention in a typical operating environment 

16 wherein it communicates by wireless communication with 

17 a computer 11, such as a notebook PC having an 

18 associated receiver 12, such as a model RB 1023 RF 

19 receiver, commercially available from RF Monolithics, 

20 Inc.. of Dallas, Texas. Receiver 12 may communicate 

21 with computer 11 via the RS 232 port thereof or 

22 alternatively via the keyboard input thereof. 
23 

24 The handwriting input device 10, which is 

25 illustrated in greater detail in Fig. 2, may be used on 

26 any writing surface or alternatively in the absence of 

27 a writing surface and does not require any special pad 

28 or writing substrate. Preferably the handwriting input 

29 device comprises a housing 13 in the general size and 

30 shape of an ordinary pen which is preferably provided 

31 with suitable indentations 14 for predetermined finger 

32 engagement. 

33 Disposed in housing 13 is an ink reservoir 

34 and output point assembly 16, which may be constructed 

35 and operative in any conventional manner. Alternatively 

36 no ink output may be provided. In accordance with a 

37 preferred embodiment of the present invention there is 

38 disposed in a forward location of the housing 13 an 
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1 accelerome ter 20, preferably operative in* three 

2 dimensions. Preferably the accelerometer 20 is located 

3 interiorly of indentations 1*1. A typical accelerometer 

4 which meets the size and power requirements of the 

5 invention comprises at least two and preferably three 

6 mutually orthogonally mounted Model 3031 accelerome ters 

7 commercially available from EuroSensor of 20 - 24 Kirby 

8 Street, London, England. 

9 Referring additionally to Fig. 3. it is seen 

10 that the output of the accelerometer 20 is supplied via 

11 an operational amplifier 24, such as a model LT1179, 

12 commercially available fcom Linear Technology 

13 Corporation of Milpitas, California, to a 

14 microcontroller 26, such as an Hitachi H8/536 

15 microcontroller including an A/D converter. 

16 Microcontroller 26 is operative to extract a plurality 

17 of predetermined features of the acceleration sensed by 

18 accelerometer 20. It is a particular feature of the 

19 present invention that a relatively small number of 

20 discrete features derived from sensed acceleration 

21 during handwriting has been found to be sufficient to 

22 map the alphanumeric symbols of a given individual. It 

23 is appreciated that the characteristics of such 

24 features vary from individual to individual and 

25 accordingly, the microcontroller must be personalized 

26 through training in order to select suitable feature 

27 characteristics for a given individual. 
28 

29 A typical catalog of features extracted by 

30 the microcontroller 26 appears in the Tappert et al 

31 reference described hereinabove and is hereby 

32 incorporated by reference and also appears more 

33 explicitly in Appendix B. A preferred listing of 

34 software that provides the functionality of the 

35 microcontroller 26 appears in Appendix C. 

36 The microcontroller 26 provides the 

37 functionality of a bank of parallel recognizers 26. 

38 The parallel recognizers are operative to recognize 
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1 128 different symbols. They may also be operative to 

2 recognizers various graphic symbols. The parallel 

3 recognizers are also personalized by suitable training 

4 which is preferably carried out using the pen 10 and 

5 the computer 11 and involves subsequent downloading to 

6 the pen 12, so as to associate the various alphanumeric 

7 symbols with given acceleration derived features 

8 extracted by the microcontroller 26. 

9 The microcontroller 26 also provides the 

10 functionality of post-processing circuitry and is 

11 operative to select the most probable symbol from among 

12 those recognized by the bank of parallel recognizer and 

13 to encode it in a conventional universal code, such as 

14 ASCII, which is not in any way dependent on the 

15 personal handwriting characteristics of a given 

16 individual and which can be readily accepted by 

17 conventional computers. 

18 Preferably, the coded symbol output from 

19 microcontroller 26 is in a form compatible with or 

20 identical to the output conventionally received at the 

21 keyboard input of a conventional computer, such as a 

22 PC. 

23 In accordance with a preferred embodiment of 

24 the present invention, the coded output of 

25 microcontroller 26 is transmitted to computer 11 in a 

26 wireless manner by a wireless transmitter 32, such as 

27 a model MB1003. which is also commercially available 

28 from RF Monolithics, Inc. and which communicates with 

29 receiver 12 (Fig 1). Alternatively any other suitable 

30 IR transmitter or radio transmitter may be utilized. In 

31 such a case, the computer 11 is preferably supplied 

32 with a corresponding receiver which outputs directly to 

33 the keyboard input of the computer or any other 
3** suitable input, such as an RS 232 port. Alternatively a 

35 non-wireless communication connection may be provided. 

36 A suitable battery 33 is provided to power the 

37 apparatus located within housing 13. 

38 It will be appreciated that the handwriting 
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1 reading apparatus of the present invention is 

2 preferably a hand-held, personalized "pen" which can be 

3 carried by the individual for whom it has been 

4 personalized and used with any computer having suitable 

5 communication facilities. The computer need not be 

6 * personalized in any way, inasmuch as all of the 

7 handwriting recognition hardware and software is 

8 resident in the "pen". 

9 Reference is now made to Fig. 4 and Fig. 5 

10 which illustrate portions of the apparatus of Figs. 1 - 

11 3 in differing levels of detail. The accelerome ter 20, 

12 as noted above, preferably comprises three separate 

13 accelerometer modules, each including a bridge 

14 containing piezoresis tive elements outputs via 

15 operational amplifier 24 to microcontroller 26 

16 including A/D converter channels 44. As noted above, 

17 the microcontroller 26 provides DSP functionality, 

18 represented by block 45 which is preferably operative 

19 to extract 32 features which are combinations of 

20 components of X-acceleration , Y-acceleration and up and 

21 down movements of the pen . 

22 The output of functional block 45 is supplied 

23 to the bank of parallel recognizers 26 which includes a 

24 plurality of fuzzy comparators 46, each of which 

25 receives from reference feature storage facility 47 

26 reference features for a plurality of alphanumeric 

27 symbols in addition to the serial input from DSP 

28 circuitry 24 which contains vectors representing the 

29 extracted features. The outputs of the fuzzy 

30 comparators 46 are supplied to corresponding error 

31 accumulators 48. The outputs of the error accumulators 

32 48 are supplied to a fuzzy associative memory 50 which 

33 receives threshold inputs from a threshold definer 52. 

34 Threshold definer 52 receives data inputs together with 

35 control and timing inputs. 

36 It is appreciated that in accordance with a 

37 preferred embodiment of the invention, the structure of 

38 Figs. . 4 and 5 is embodied in software resident in 
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1 microcontroller 26. as exemplified in Appendix C. 

2 Figs. 6A and 6B are simplified flow charts 

3 illustrating operation of the DSP block 45 (Fig 4) . 

4 Fig. 6A illustrates the teaching process and Fig. B 

5 illustrates the recognition process. The DSP block 

6 operates to perform double integration of X and Y 

7 acceleration to obtain not only velocities, but also 

8 positions and travel distances. In addition, non- 

9 linear positive and negative rotations are counted, 

10 located and their length recorded. 

11 Appendix D sets forth an alogorithm for 

12 personalization of the handwriting reading device of 

13 Figs. 3-5. 

lb The personalized functions are carried out 

15 using the pen 10 and the computer 11. The user 

16 initially writes each alpha-numeric symbol. The symbol 

17 is "read" by the device which determines X t Y and Z 

18 accelerations, and employs the accelerations to extract 

19 the features listed above, in a manner set forth 

20 generally in Fig. 6. Feature recognition is achieved by 

21 recognizing the centroids of the pen-strokes of the 

22 individual writing and by classifying of each character 

23 into 12-16 pen-stroke types. The character is 

24 considered to be a sequence of certain pen-strokes and 

25 is recognized as a fuzzy string over the pen-strokes 

26 alphabet. The fuzzy rules are downloaded to the 

27 microcontroller 26 in the pen 10. 

28 The extracted features are employed to adapt 

29 fuzzy rules. The fuzzy rules are employed in the 

30 operation of a symbol recognizer which provides output 

31 indication of a recognized symbol. 

32 The actual and recognized symbols are 

33 compared to provide a difference indication which is 

34 used to further adapt the fuzzy rules until an 

35 acceptable match between the actual and recognized 

36 symbol is attained. 

37 Additionally in accordance with a preferred 

38 embodiment of the present invention there is provided 
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1 audio- visual apparatus including apparatus for 

2 providing a human sensible output including information 

3 in at least one of audio and visual form and having as 

4 an input element hand-held apparatus for sensing motion 

5 during handwriting of the type described hereinabove. 

6 Examples of such audio-visual apparatus 

7 include a video recorder and player, a stereo audio 

8 player and a television. Other home appliances such as 

9 washing machines and cooking apparatus may be operated 

10 along similar principles. 

11 Further in accordance with a preferred 

12 embodiment of the present invention there is provided 

13 portable information storage and retrieval apparatus 
1*1 including a portable computer memory and output device 

15 and having as an input element hand-held apparatus for 

16 sensing motion during handwriting of the type described 

17 hereinabove. 

18 Examples of such portable information storage 

19 and retrieval apparatus include a digital watch with 

20 memory, a computerized diary, a computerized dictionary 

21 and electronic telephone book. 

22 Additionally in accordance with a preferred 

23 embodiment of the present invention there is provided 
2k lock apparatus including locking apparatus responsive 

25 to a predetermined electronic input and having as an 

26 input element hand-held apparatus for sensing motion 

27 during handwriting of the type described hereinabove. 

28 Examples of such locking apparatus include 

29 door locks and vehicle door locks and ignitions. 

30 Further in accordance with a preferred 

31 embodiment of the present invention there is provided 

32 magnetic card activated apparatus including apparatus 

33 for reading a magnetic card and having as a 
3*J verification input element, hand-held apparatus for 

35 sensing motion during handwriting of the type described 

36 hereinabove. 

37 Examples of such magnetic card activated 

38 apparatus include automatic teller apparatus and point 
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1 of sales credit card acceptance units. 

2 It will be appreciated by persons skilled in 

3 the art that the present invention is not limited by 

4 what has been particularly shown and described 

5 hereinabove. Rather the scope of the present invention 

6 is defined only by the claims which follow: 
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APPENDIX A 

What the human brain tells the human 

hand 

A behavioral perspective 

Ehud Bar- On 
E.B. Research k Development Ltd. 
Guttwirth Bldgs, Technion, Haifa 32000, Israel 

September 22 ? 1992 

Abstract 

This study investigates the primitives of motoric patterns of hand 
movement during handwriting. This is referred to as the "language" 
between the "hand and the "brain", and as such, has its own vocabu- 
lary and syntax. The "vocabulary * is the pen strokes and the syntax is 
how they are combined to pen strokes sequences. The handwriting is 
viewed as a high level cognitive activity of communicating, expressed 
as a complex motor skill and its investigation provides insight into the 
processes of chunking and automaticity. The main finding of this study 
is that pen strokes are specific to an individual writer, and character- 
ize the writer's unique motoric control mechanism. The dynamic data 
of many thousand handwritten characters, produced by many writers, 
had been analyzed. The time domain signals were segmented into dis* 
crete pen strokes units and represented as vectors in a feature space. 
Those vectors were clustered, using a variety of clustering techniques. 
We found that in spite of the fact that the hand movements during 
writing could take any form or shape, a particular writer employs only 
a very limited set of pen strokes. The results of the clustering by cor- 
ioo5 methods, yields a limited set of only twelve to fourteen types of 
pen strokes that accounts for 90brain supposedly chunks information 
to minimize the required attentional resources. 
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hcyicords: handwriting, human motor conlrvl.chunking, automatic- 
\ty, conntctionism 



1 Humans motor behavior 

When we speak about "what the human brain tells the human hand" we 
speak about the kind of "motor control language*, that might exist between 
the brain and the "hand". While this "brain-hand" communication can 
be approached from different points of view, we studv it from a behavioral 
perspective. That is. we investigate the evidence of chunks or what is referred 
to as motor programs", by analyzing the dynamic data collected during 
experiments in hand-writing recognition. Although all the results reported 
in this article consists only on the output of the handwriting process, we try 
to make the proposed model cognitive and biological plausible 

We'll start with the cognitive plausibility. There is a strong link between 
cognitive mechanisms and the human motor behavior. Handwriting is the 
way that humans express their thoughts through the use of a complex motor 
skill. Rosenbaum (12J, presented handwriting as culmination of several in- 
ternal translation process. First, an abstract message or idea is constructed 
Then, it is formulated into appropriate linguistic expression, and then trans- 
lated as a series of efferent commands. There is a basic similarity between 
speech and writing, so we can assume that both share the same underlying 
mechanism. The phonemes in speech, correspond to pen-strokes in writing 
and the morpheme in speech correspond to letters. The higher levels of ah-' 
straction (i.e. words, syntax, lexicon, semantics, prosody and discourse) are 
probably the same. 

There is an empirical evidence, that the ability to sequence behavior 
whether m the linguistic domain or drawing domain, depends on a central,' 
amodal mechanism (11). If this is true, then motoric control should be consid- 
ered as obeying the same rules of the linguistic or other sequential cognitive 
mechanisms. On the other hand, some of the properties that we discover 
about the primitives of the motor control language, might be generalized to 
other cognitive activities. In the case of handwriting, the efferent commands 
are expressed as pen-strokes. It was found by Wright [17], that different pro- 
duction mechanism are probably controlled by the same high-level graphic 
representation. This view of hierarchical structuring, and a "virtual- repre- 
sentation of motor movement is supported by empirical evidence. Human, 
can write ,n a consistent style when they write in small letters in their note- 
books, or when writing much bigger characters on a blackboard. Moreover 
people can write with a consistent style (same pen-strokes). when using dif- 
ferent effectors like hand and foot. 8 
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As in any behavioral research, resulting behavior is influenced both by 
the general properties of handwriting and by properties which are specific 
to an individual writer, This means that a considerable part of the variance 
can be attributed to individual differences. It has been noticed bv many 
researchers that handwriting style is so distinctive, that writers can be rec- 
ognized according to their hand writing. This is also a common knowledge, 
and therefore signatures are recognized as a unique identifier of a specific 
writer. Some theories even associate personality traits with hand-writing 
style. As we intend to show in this article, the primitive pattern of writing, 
are unique for individuals writers. 

As any other cognitive or motor activity, human motor control goes 
through a process of development that is equivalent to intellectual develop- 
ment. An interesting well known phenomena is that children's drawing (and 
after that writing), becomes more refined over the course of development. It 
has been suggested by many researchers, that early drawing behavior corre- 
lates with young children's cognitive abilities. Van sommers (15), suggested 
that drawing may be governed by high-level rules, similar to those governing 
language processing, and that the development in drawing may parallel the 
development of language. Goodnow and Levine (9) even suggested a: "Gram- 
mar for action: sequence and syntax of children's copying." They reported 
several rules for sequencing drawing strokes. Examples of such rules were:" 
Start at leftmost point" , "Start at top n , "Start with vertical strokes", "draw 
horizontal lines from left to right", etc. The evolutionary rationale for such 
rules could be to simplify motor planning. 

The biological plausibility of an hand writing model, involves two parts: 
The plausibility of the assumed neurological control, and the biomechanical 
properties of the hand. The preservation of the writing style while using dif- 
ferent muscles and even organs, is one of the most intriguing questions. The 
automaticity of writing, suggests a chunking mechanism, but this chunking 
mechanism is probably not in the motoric system of the hand, but somewhere 
in the upper control levels of the brain. Therefore, whenever we refer to 
the "hand", we do it metaphorically. I.e. the "hand" represents the efferent 
mechanism that accomplishes the motoric control. Recently, Alexander et al. 
[3], raised the question whether the specific concept of a "motor program", is 
an appropriate foundation for the development of biological plausible models 
of how the brain controls movements. While our current knowledge about 
the cortical and basal ganglia motor areas is still far from allowing a specific 
model, it can suggest what models are more neurologically plausible than 
others. Fischbach (7) discusses the finding about "face cells" and "motor 
command cells" as an evidence for abstraction in the brain. In the monkey's 
visual system, "face cells" located in the inferior temporal sulcus, were sug- 
gested as- representing a high level of abstraction. These neurons respond to 
faces but not to other visual stimuli. Face cells have their counterparts on the 
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motor side. "Command" neurons have been identified in certain vertebrates 
that trigger fixed action patterns. Georgopolos [1] recorded electrical activ- 
ity of single neurons, and found command neurons in the monkey's motor 
cortex (precentral gyrus) that encode the direction of forelimb movement. 
The firing of these neurons was not associated with the contraction of a par- 
ticular muscle or with the force of the coordinate movement. Georgopoulos 
computed a vector by summing the firing frequencies of many neurons, and 
found that it is more correlated with the direction of movement than is the 
activity of any individual cell. The vector becomes evident several millisec- 
onds before the arm moves. He interpreted this result as evidence for motor 
neuron planing. Damasio and Damasio [4] discussed the linguistic behavior 
of patients with lesion in the left posterior temporal and inferior parietal cor- 
tex. It was found that such patients have problem in producing word forms 
from the available phonemes. Analyzing the accumulated empirical finding 
on language structures, gathered with assistance of imaging techniques like 
MRI (Magnetic Resonance Imaging) and PET (Positron Emmision Tomog- 
raphy), shows that linguistic activity like naming, involves the motor cortex 
activation together with anterior and posterior language centers in the left 
hemisphere. Writing is a language activity which involves a production cen- 
ter that forms words and activates the "command cells" in the motor cortex 
to produce pen-strokes sequences (letters) and written words. Id the same 
way that speech is composed of a small set of phonemes, we argue that 
handwritten letters are composed of a small set of pen-strokes. 

In addition to the neurological plausibility, there are biomechanic con- 
straints on the "hand" part. Some general principles have been suggested 
as governing this control mechanism. For example. Flash and Hogan (8), 
proposed that humans tend to write in a way that minimizes ;erJL That is* 
the third time derivative of the position signal. A more recent study [6]] 
suggested the snap, which is the fourth derivative of position, as the cost 
function that is minimized. As we will see, there are alternative hypotheses 
about the type of constraints imposed on the biomechanics of handwriting. 
In spite of the fact that the principle that governs the handwriting might 
be universal, each writer has its own unique variation. The differences are 
more pronounced in the unwritten strokes (the pen movements that do not 
touch the writing surfaceO than in the written ones. The friction of the pen 
with the writing surface diminishes the characteristics of the hand control 
mechanism which are better revealed when the pen is up. 

The article starts with reviewing theories of "motor programs", and ar- 
guing against that teqn and what it implies. We'll propose an alternative 
connectionist model of primitive hand-writing patterns and argue that it is 
more biologically and cognitive plausible. Then, we describe the experiment, 
and the collection of the data. The fourth chapter will describe the analysis 
of the collected data, and the conclusions that were drawn from this analy- 
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sis. The last chapter will discuss the results, and compare our conclusions to 
alternative ones. We shall conclude the article by pointing out some future 
directions and implications of the suggested model. 



2 Attention, chunking and "motor programs" 

The concept of "working memory" is modeled after the "working memory" 
in a (von Neumann) computer, where the registers in the Central Processing 
Unit (CPU) have a similar function. This is also whv researchers in that field 
prefer to talk about "motor programs". "Motor programs" are supposed 
to save attentional resources. According to this approach, it is assumed 
that the brain controls movements like handwriting, by executing "motor- 
programs", much like software is used in a computer (e.g. [12J ). The "motor 
program" concept is attractive, as it reduces the complexity of the sequential, 
analytical approach by using pre-programmed sequences of a limited number 
of generic motor commands (or routines), to control a large repertoire of 
movements. Alexander et al. (3) points out difficulties with the neurological 
plausibility of "motor programs" that imply separation between "software" 
and "hardware 1 *. For example, what would constitute the software in such 
a model, and where it is stored when not executed, how are they assembled 
prior to their execution and how new programs are created. A major problem 
with the w motor program" approach is also the sequencing of performance: 
goal- directed movements are supposed to be translated into trajectories, 
then to joints kinematics. Muscle activation cannot be computed until the 
inverse dynamics is calculated and so on. Therefore, argue Alexander et al., 
signs of specialization for such transformations should have been found in 
the cortical and basal ganglia. Thusfar, neurobiological evidence seems to 
indicate lack of such specialization. 

It is assumed that the processing capacity is limited, and therefore sev- 
eral tasks that have to be carried out simultaneously compete on the same 
resources. The main * problem" of human-beings and other organism might 
be, that we lack a "parallel output channel". All the output channels, be it 
speech, handwriting or any other motor output, are all serial in nature. It 
might be that this serial output suggested a serial cognitive mechanism as 
well. It is the conjecture of the neural-nets literature, and of this article, that 
the underlying mechanism is parallel and distributed over millions of simple 
processing units (neurons). Therefore, the term "motor programs", that im- 
plies a serial symbolic process running in the "brain-computer" might be 
misleading. We prefer to speak about "motoric schemas", which are motoric 
patterns invoked by activation of an assembly of neurons. 

The connectionist view of schemas (Smolensky, 19S6) is that stored knowledge- 
atoms are dynamically assembled at the time of inference, into context- 
sensitive schemata. Rumelhart and McClelland (19S6) (14) proposed a tech- 
nique that suggests how an attentional selective mechanism might work. 
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They propose the use of a set of mapping units which produce 'dynami- 
cally programmable connections" and achieve focusing on different features 
on different times. Smolensky (19S6) maintains that schemata are coherent 
assemblies of knowledge atoms, where coherence or consistency is formalized 
under the name of harmony. He proposes the harmony principle: the cogni- 
tive system is activating coherent assemblies of atoms, and draws inferences 
that are consistent with the knowledge represented by the activated atoms. 

In much the same way, we propose to speak about "motoric schemas". 
This is consistent with our conjecture that there is no essential difference 
between the so-called "cognitive** and "motoric" brain. mechanism. The con- 
nectionist schema-model is also consistent with the neural evidence, that 
the specialization among different cortical motor areas are related to certain 
sequences of movements, and not to transformations as proposed by the "mo- 
tor program" literature. According to our conjecture, preparatory units and 
movement executing units will belong to the same schema. This is supported 
by the anatomical fact that the three motor areas (SMA - Supplementary 
Motor Area, PMC - Primary Motor Cortex and Putamen), has the same 
proportion of target dependent motor cells and limb dependent movement- 
related cells ([2] ). Another supporting evidence is that neuronal population 
that were supposed to represent different stages of computation (according 
to the "motor program" view), have been shown to be active simultaneously. 

3 The experiment 
3.1 Data collection 

Rumelhart [13] developed a system which learns to recognize cursive script as 
it is generated by a writer. This system learns from examples of cursive script 
produced by a number of writers and recorded. He collected approximately 
1000 words from each of 58 writers. The average length of a word is about 8 
characters, That sums up to nearly 500,000 examples of handwritten cursive 
characters. His results were encouraging and had been used in this research. 
While Rumelhart [13] was mainly interested in handwriting recognition, this 
article uses the same data to investigate the writing mechanism. 

The data were collected in the following manner. Each word in the corpus 
was recorded. It was then played to the writer who was instructed to write 
the word on a tablet digitizer. The resulting x coordinate, y coordinate and 
an indication of whether the pen was or was not on the paper were sampled 
each 10 milliseconds. The resolution ( more than 200 dpi) and the sampling 
rate (100 samples/sec) are those that are shown to be appropriate in the 
on-line hand-writing recognition literature ((16) ). The data was saved as 
files, and has been used for the analysis reported in this article. 
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In addition to the data from Rumelhart's experiment, several thousands 
pen strokes of Japanese handwriting were collected. Most of the data has 
been collected from hand written Hiragana characters, but some data has 
been collected during writing Kanji (idiographic) Japanese characters. Hi- 
ragana characters has the curved shapes of english hand printed characters, 
but without the ligature of cursive handwriting. 

Preprocessing of the hand-writing raw data has been made, with the 
goal of extracting features that will be used to segment and characterize the 
"pen-strokes". A pen stroke was defined as a segments of the cursive writing 
signal, between two consecutive zero crossing of the vertical velocity of the 
pen movement. Each character was segmented to several segments or "pen- 
strokes". A typical writing rate in English is two letters per second. Writing 
Japanese characters (Hiragana), takes about the same time, and a typical 
Hiragana character can be written in 0.3 - 0.5 seconds. 



3.2 Segmentation and feature extraction 

The principle of segmentation and feature extraction is to segment the con- 
tinuous signals into discrete segments and to represent each segment by a 
feature vector in the feature space. 

The segmentation that produces "pen-strokes" out of the continuous sig- 
nals, depends on the different definitions of the term" pen-strokes". While 
most of the literature about on-line character recognition is using this term, 
there isn't an agreed upon definition of a "pen-stroke". For example, one 
often finds only the pen-state change as the only criteria. That is, defini- 
tion of a stroke as continuous pen-movement, between pen-down and pen-up 
consecutive states [16). 

Once a "pen-stroke" is defined, there are many ways to represent it in 
a feature space. The on-line character recognition research employs several 
orthogonal transformations such as a discrete Fourier transform of the curve 
segments corresponding to the pen-strokes. That is, a pen-stroke is repre- 
sented by its Fourier coefficients obtained from its x(t) and y(t) signals. Es- 
sentially, any orthogonal transformation (e.g. Walsh transform, Karhunen- 
Loeve) could do in approximating the pen-strokes curves. That is, Plane 
curves can be approximated by orthogonal functions (Sinusoidal, polynomial 
or even square waves). This description can be also easily converted to the 
frequency domain, as was done in several studies of hand-writing recognition 
(16|. 

This mapping of the time domain to a parametric domain is advanta- 
geous when the characters can be represented by a small number of coeffi- 
cients. Therefore, periodical smooth curves lend themselves better to mod- 
eling by harmonic functions, as one needs less coefficients. On the other 
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hand, straight line strokes require high order harmonies as they include high 
frequency components. This is why sinusoidal approximation is useful for 
characters consisting of curved strokes, as found in English cursive script, 
more than for Japanese Kanji characters (that are made mainly of straight 
line segments), K-L expansion has been proved to be a successful algorithm 
in machine-printed Chinese character recognition. Another successful at- 
tempt was to use a modified Hough transform for recognition of Chinese 
hand-written characters. The Hough transform is a technique for line detec- 
tion and has been generalized to detect arbitrary shapes. Chinese characters 
are line-like, and therefor lend themselves naturally to a Hough transform 
representation. 

The segmentation and feature extraction methods depend of course, on 
the goal. If the goal is pattern recognition, then the segmentation and feature 
extraction are geared toward discrimination between the various patterns. In 
our case, we looked for a segmentation and features that are biological plau- 
sible. Consequently, we investigated only features that might be explained 
by the neurobiological control structures, like the direction of the strokes, 
their curvature etc. 

3.3 Hollerbach's model 

The segmentation and feature extraction mechanism employed was, to de- 
velop a model of the underlying handwriting process and to describe the data 
in terms of the parameters of the model. The model employed was derived 
from that of Hollerbach [10] and involved the assumption that the genera- 
tion process could be described as pair of coupled oscillators.. The coupled 
harmonic oscillators is just one of the many models that exist. Actually, 
its basic assumption about the symmetric shape of the velocity profile (an 
half sinus shape), is probably an oversimplification. The literature about 
velocity profiles of pen-strokes usually assumes an asymetrical bell-shaped 
velocity profile. That is, a rapid-aimed movement described by a log-normal 
velocity profile is considered as the fundamental unit (stroke). More com- 
plex movements are described in terms of superimposed log-normal curves. 
The asymmetric nature of the velocity bell-shaped profile results from the 
global stochastic behavior of a large number of processes involved in velocity 
control. 

In spite of being an oversimplified and inaccurate model, it has a clear 
advantage that it is based on a control mechanism, and is neuorobiologically 
interpretable. This model assumed that: 

x = acos(u> r * + <j>) + c (1) 
y = 6cos(<V) (2) 
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In words, the idea is simply that writing involves two orthogonal pendular 
movements. If we speak about writing in a notebook (small sire letters), we 
can think about the wrist horizontal movements (actually, it is more arc-like 
movements) and the fingers flexion andextension vertical movement. These 
two movements can be considered as independent. If the size of the letters 
is more than an intch, than the arm muscles are involved. 

According to this model, The y-axis consists of a series of up/down strokes 
whose velocity profile is assumed to be sinusoidal. The i-axis is also pendular 
with a constant velocity, c, to the right. Different characters are made by 
modulating the relative amplitudes, a and 5, the relative phase, phi. and the 
relative frequency + x and u/ y t in the z and y directions. It is, furthermore 
assumed that the parameters change only when the velocity in the y direction 
reaches zero (end of pen-stroke). Thus, we define a stroke as the motion 
between zero crossings in the y velocity - v y . In addition, segmentation 
occurs when the pen-state changes (from pen-down to pen-up or vice versa). 

It should be stressed that Hollerbach's model was designed for synthesiz- 
ing handwritten-like character, by a second order mechanical system. This 
model does not try to imitate the human motor control, or to be used for 
analysis of human handwriting. However, as it is a control system model, 
some of the parameters might be interpreted in terms of the human biome- 
chanical system. For example, the parameter <t>, which designates the phase 
shift, can be interpreted as relating to the delay in the nervous-muscular 
control system. As such, it can have an important diagnostic value in motor 
diseases. 

When it was applied by Rumelhart to handwriting analysis, it suffered 
from some drawbacks. One of them is that the model is fitted not to the 
image, but to the velocity profile of the stroke. This simplifications tend 
to work well in most of the cases of English cursive hand-writing, because of 
the periodical nature of the v v velocity signal. 

As the Hollerbach model that we used, is based mainly on the velocity sig- 
nals, we will illustrate the transformation from the x - y domain of the hand- 




Figure 1: The handwritten letter d 
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Figure 2: The v x graph for the handwritten letter d 

written character, to the corresponding veJocities. Examples of the handwrit- 
ten letter d, the corresponding velocity profiles and the reconstructed d are 
shown in Figures 1,2,3 and 4. 

As can be seen, the reconstruction isn't perfect, and the curvature of the 
first pen-stroke of the d is opposite to the original. This result illustrates the 
fact that the model tries to reconstruct the velocities and not the resulting 
pen strokes image. 

This does not exclude the fact that sinusoidal approximation worked for 
Rumelhart m recognition of cursive script. It turned out that in some cases 
(periodic signals during cursive handwriting in English) the model worked 
satisfactorily. 

The Kanji characters, on the other hand, have more short straight seg- 
ments, as can be seen in the following figures: 

The "mori" Kanji character in the picture, is segmented to 27 pen-strokes 
(the last two pen-down strokes in the third "tree" are missing). Sixteen out 
of the twenty seven, are strokes in which the pen touched the paper, and 11 
were just for moving the pen from one line to the other. Twelve sequences of 
pen-down" strokes, correspond to the visible line segments in the character. 
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Figure 3: The v y graph for the handwritten letter d 
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Figure 4: The reconstructed letter d 
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Figure 5: The separate strokes are more evident in Japanese Kanji characters. 
This is the Kanji character: n mori n , which means: forest 



v 


x 1 


Mid 


Velocity 


Harmony | 


Pea up- down 


0.70 


7.41 


0.74 


-2.95 


4 


1 


3.44 


-3.S6 


-2.77 


-2.20 


4 


0 


-10.56 


-0.45 


-0.01 




2 


1 


0.71 


-0.13 


0.04 


-0.33 


2 


1 


4.40 


0.08 


-0.59 


2.62 


2 


0 


-4.20 


-4.94 


-1.88 


-3.19 


2 


1 


3.87 


4.61 


1.55 


5.46 


2 


0 




5.51 


3.63 


-2.33 


2 


1 


74 


-15:08 


-7.31 


-4.36 


o 


0 


1 64 


9.70 


2.62 


8.60 


2 


1 


n d9 


-1.46 


0.23 


-4.40 


2 


1 


1 97 


-1 99 


-1.85 


0.75 


2 


0 


Q 71 




-0.04 


-0.20 


2 


1 


S 4£ 


0.47 


-1.20 


3.70 


4 


0 


-5.40 


-5.S5 


-3.39 


-2.74 


4 


1 


4.29 


4.89 


0.84 


10.50 


2 


0 


-1.91 


4.29 


3.38 


-1.56 


2 


1 


3.91 


-0.64 


1.55 


-3.30 


4 


0 


1.82 


9.72 


3.70 


6.74 


2 


1 


0.07 


-1.35 


0.46 


-5.25 


2 


I 


2.00 


-2.17 


-2.12 


1.86 


2 


0 


-9.60 


-0.18 


-0.18 


-0.28 


4 


1 


0.98 


-0.37 


-0.09 


-0.74 


2 


1 


4.52 


0.57 


•0.33 


-0.12 


4 


0 


-4.22 


-5.45 


•2.72 


-2.64 


4 


1 


4.14 


6.24 


4.40 


5.90 


4 


0 


-5.10 


7.23 


4.61 


0.54 


4 


1 



SUBSTITUTE SHEET 



WO 94/09447 



PCT/US92/08703 




Figure 7: The reconstructed Kanji character: "mori". 
The reconstructed Kanji character is depicted in the figure. 

3.4 Recognizing pen-strokes sequences 

One of the key problems in recognizing cursive handwriting is the segmen- 
tation problem. Rumelhart (13) has devised a learning algorithm for cursive 
handwriting recognition which combines word recognition and letter recog- 
nition. The letter recognition is based on recognizing PMPs, and PMPs 
sequences make letters. This system involves simultaneously learning to rec- 
ognize and segment letters. 

Although Rumelhart 's experiment was done for hand-writing recognition, 
there are several things that can be learned from it, concerning the PMPs and 
their sequencing during handwriting. It was recognized in the early sixties 
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((6)). that motor knowledge can be used in recognition of hand-writing A 
system called Analysis by synthesis suggests that characters are recognized by 
their n motor programs". These "motor programs" are supposedly deduced 
by guessing an initial program, and iteratively updating it according to the 
difference between the synthesized and actual forms. The connection between 
reading and writing process have been corroborated by the co-occurrence of 
certain kinds of acquired dysgraphia and dyslexia ((5|). In contrast to ear- 
lier approaches, Edelman et al., ((6)), assumes that while readers use motor 
knowledge in reading, they do not seem to do so by mentally reproducing 
the process of writing. The connectionist model that we propose isn't both- 
ered, of course, by those distinctions between explicit simulation or implicit 
knowledge. This is another example of the misleading influence created by 
the "motor programs" metaphor. 

4 The results of clustering 
4.1 fixed radius clustering 

The basic units of clustering were the pen-strokes, each of which was rep- 
resented as a point in an n dimensional space. Out of the six features that 
we extracted for each stroke only three have been used. First, we used only 
one frequency for the modeling, so the rare strokes that involved higher har- 
monies were removed. Second, we did not differentiated between Up-strokes 
and Down-strokes. Up strokes contain more high order harmonies, but we 
limited our analysis to the basic movements, and tried to ignore the fluctu- 
ation induced by the bio-mechanical control mechanism. The third feature 
that wasn't used was the mid-point. For the reconstruction of the pen-strokes 
in the spatial domain, the x-coordinate of the midpoint in each stroke was 
computed. However, our preliminary analysis showed that this variable was 
very highly correlated with the i variable. This preliminary analysis, yielded 
three variables that were almost uncorrelated: A r ,&K and velocity. The 
dimension of the space were: 

1. A y - The relative displacement on the vertical direction. 

2. A x - The relative displacement on the horizontal direction. 
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3. v - v The v x velocity at the end of the stroke is calculated according to 
equation below. 

For a pen-stroke between a and 6, which is approximated by a certain 
oscillation frequency, we calculate: 



It is calculated in a different way for different and this is an example 
of such a calculation. 

The clustering of data from many writers, didn't yield satisfactorily clus- 
tering, but the clustering of individual writers did. E.g. the clustering for a 
particular writer, revealed 13 compact clusters that contained 90to 14, were 
consistent to all the writers we analyzed. This is a corroboration to our con- 
jecture that hand writing is made out of a small number of PMPs, which are 
unique to an individual writer. 

The centroids of the clusters, were reconstructed from the feature space, 
and axe displayed on a 2-D spatial domain. As can be seen clearly from the 
results, different writers have different stroke types: 

As each writer has about 25,000 pen-strokes that we wanted to cluster, 
we started with a fast clustering algorithm, similar to the k- means algorithm. 
The main requirement of the clustering algorithm were that it will be able 
to deal with very large data sets and find satisfactory clusters in few (2-3) 
iterations. The other requirement, which was even more important, was that 
the centroids will be good representations of the observations within each 
cluster. This requirement lead to seeking compact, hyperspherical clusters, 
that do not exceed a predefined radius. Elongate clusters are therefore repre- 
sented by several adjacent clusters. Those clusters will be merged in a latter 
stage by an hierarchical clustering algorithm. 

The clustering employed a two phase strategy. First, a fast "nearest 
centroid sorting" algorithm was employed to reveal the clusters in the large 
data set. Then, the resulting centroids of the clusters have been submitted 
to different hierarchical clustering methods. The first phase algorithm was 
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Figure 9: Thirteen centroid pen-strokes of an individual writer, including 
their relative frequencies. 



SUBSTITUTE SHEET 



WO 94/09447 



PCT/US92/08703 



- 30 - 



sensitive to outlier strokes, that formed separate clusters. This was the reason 
why we got many very small clusters. These clusters accounted for less than 
lOof he observations They were considered to be noise, or very exeptional 
pen strokes, and have been removed so not to inBuence the representativeness 
of the centroids of the large clusters. 

The second phase included clustering of the resulting centroids using ten 
different methods. We distinguished between methods that yield compact 
hyperspherical clusters, and those that can detect elongate clusters. We 
start with the first group of eight clustering methods: 

1. Average Linkage cluster analysis 

2. Centroid hierarchical cluster analysis 

3. complete linkage cluster analysis 

4. Equal variance maximum likelihood method 

5. Flexible data cluster analysis 

6. McQuitty's similarity analysis 

7. Median Hierarchical cluster analysis 

S. Ward's minimum variance cluster analysis 

The different methods tend to favor different characteristics such as size 
shape or dispersion. For example, methods based on the least-squares cri- 
terion such as k-means or Ward's minimum variance method, tend to find 
clusters with roughly the same number of observations in each cluster. Aver- 
age linkage is biased toward finding clusters of equal variance. Most cluster- 
ing algorithms, except for single-linkage and density-linkage, tend to produce 
compact, roughly hyperspherical clusters. The clustering methods which are 
based on nonparametric density estimation, like the single linkage, will be 
discussed later in this chapter. 

All the above clustering methods yielded very similar results, and the 
tree-based partition was essentially the same. The use of many different 
algorithms has been employed to investigate the robustness of the clustering 
structure under different hierarchical clustering methods. The result of all 
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Figure 10: Hierarchical (compact) clustering of the 12 pen-strokes cent raids 
of a particular writer 

the above method revealed the following tree-based partition of the set of 
the basic twelve pen-strokes (of a particular writer). 

From looking at the results of the hierarchical clustering, there is an ob- 
vious super-clusters that emerge. The horizontal-left strokes are one such 
a group, long down strokes are another group. In general we see a distinc- 
tion between horizontal strokes and vertical strokes. The horizontal strokes 
themselves are subdivided to horizontal-left directed strokes, and horizontal 
right and up directed strokes. The high velocity C shaped strokes are part 
of circles or ovals. It should be noticed that for a specific writer, a certain 
stroke is always accomplished in the same way. For example, an horizontal 
short stroke, like crossing a t, will be done always as left directed strokes. 
Someone else could use only horizontal right directed strokes for that pur- 
pose. However, it is very unlikely that the same writer will use both an 
horizontal-left and horizontal-right strokes. The same is true with long ver- 
tical strokes. Once the writer is using a long vertical down-stroke, he will 
produce vertical lines always as down strokes of the same type and velocity 
profile. This organization of pen strokes was consistent in all the hierarchical 
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Figure 11: Hierarchical (Density linkage) clustering of the 12 pen-strokes of 
the same writer 

clustering algorithms that we mentioned above. 

The clustering methods that employ nonparametric density estimation, 
like the "Density linkage cluster analysis", can detect also elongated cluster 
shapes. These clustering techniques yielded two distinct super clusters: the 
"down and long pen-strokes" , and the "up and right strokes". The down 
strokes are those that form the "back-bone" of the English characters, while 
the up-right strokes are typically those that are used as ligature. 

4.1.1 The "characteristic" shape of pen-strokes 

As was argued above, any writer has a specific set of pen strokes that char- 
acterize the writer. While the same writer will have similar pen-strokes, in 
writing different languages, the frequency of appearance of a specific pen 
strokes depends, of course, on the language. In order to characterized a spe- 
cific writer, in respect to her/his pen strokes, we suggest the "Pen-strokes 
Ordering Diagram" (POD). Such PODs are displayed in the following figures. 

In spite of their strange looking, those diagrams are quite valuable,, and 
convey important information about the handwriting of the analyzed writer. 
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Figure 12: The centroids of the pen strokes of a writer, for English cursive 
writing. The pen-strokes are ordered according to their u v values, from up- 
strokes to down strokes 




Figure 13: The centroids of the pen strokes of a Japanese writer, for Japanese 
Hiragana characters. The pen-strokes are ordered according to their v, val- 
ues, from up-strokes to down strokes 
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Figure 14: The centroids of the pen strokes of a Japanese writer, for english 
characters. The pen-strokes are ordered according to their v y values, from 
up-strokes to down strokes 

There is a very clear distinction between the key strokes that these two 
writers are using. This is true to other writers as well. Each writer uses 
a unique set of pen-strokes: * different slopes, different curvetures, different 
velocity profiles and accelerations. 

5 Discussion and future research 

We will start our discussion with comparing the conclusions of Rumelhart's 
handwriting recognition experiment, and the conclusions of this study. In 
Rumelhart's handwriting recognition experiments, both writer dependent 
and writer independent recognizers have been trained. Two networks have 
been trained to recognize the writing of individual writers and one network 
has been trained on four different writers as a "writer independent" recog- 
nizer. On the writer dependent networks Rumelhart found that, for a vo- 
cabulary of 1000 words, on words never seen during training that 99top five, 
approximately 90On the writer independent data the results are somewhat 
worse. That is, about 70 

According to the results in this study, we have a basis to doubt this 
conclusion. The inter-writer variability is too big, and more writers will not 
lead necessarily to better results. 

Another finding of Rumelhart was that writers can be trained easily to 
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produce recognizable hand writing. He developed an "online - system in 
which the network recognizes (and can be trained) as the writer writes on 
the digitizer. With a little care on the part of the writer it is not difficult to 
achieve a score of better than 90correctly classified on the writer independent 
system. (It is also possible to write so that the recognizer does much more 
poorly than that.) Careful experiments on a person's ability to adjust to 
the recognizer have not been carried out. By limiting the vocabulary to 
one hundred words or less, it seems to be possible to obtain near perfect 
performance. (It will, of course, depend on the confusability of the words.) 

The main conclusion was. that it would be useful to embed the recognizer 
in a network of networks each trained on a subset of the writers - perhaps one 
for printers, one for pure cursive writers etc. This line of thought led to the 
current study, reported in this article. That is, that it may be useful to study 
the individual differences among the writers. The idea of studying individual 
differences, as a mean towards better handwriting recognition, turned out to 
start a new line of research - the study of writers unique pen-strokes, which 
is related to the topic of automaticity in brain - hand communication. 

This study started from that point. The main question that we posed 
was if individual writers have distinct sets of pen-strokes, which are con- 
sistent and well defined. The reanalysis of the data from this perspective 
encourage to believe that this is the case. Human writers have 12-14 distinct 
pen-strokes, which are characteristic for a certain writer. These pen-strokes 
are the primitive "motoric patterns"*, of which handwriting is composed. We 
showed also that the primitive pen-strokes cluster to super-clusters, thus re- 
vealing the hierarchical nature of the control mechamnism. These findings 
are consistent with the neurological literature, that we cited in the introduc- 
tion. That is, there might be "command cells", that get the activation for 
certain words (letter combinations) from another center in the brain and acti- 
vate pen-strokes mechanism. The pen-stroke is controlled by a direction and 
amplitude cells, that activate the corresponding primitive motoric patterns 
(PMPs). The next stage will be to locate the cell regions that are responsi- 
ble for this activation in the motor areas of the human brain. This is under 
research now with the help of Magnetic Resonance Imaging (MRI) method, 
when the MRI is tuned to detect cerebral blood flow. We would expect that 
the learning to write, should show itself as forming of such motoric activation 
centers, corresponding to what we have found in this study. 

Those findings have implications to the study of automaticity and chunk- 
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ing. One question to be investigated is if the motor control mechanism is 
central and a modal, as suggested by previous researchers. This can be in- 
vestigated by studying the patterns of interference between modalities. For 
example, an experiment in which the subject is instructed to pronounce one 
character, and write another character at the same time. In addition to pre- 
dicting longer Reaction Time, we can now predict interference between the 
pen stroke patterns and sequences. Another interesting question is how are 
the motoric patterns stored and how are they retrieved when needed. Our 
conjecture, which is consistent with the neural net model, is that the retrieval 
time will be independent of the number of patterns sequences. Some sup- 
port for this conjecture is that it takes the same time to write a character 
in a large character set (kanji) or small character set language (Hiragaaa, 
English). 

Future research that will combine behavioral analysis with neurobiolog- 
ical research, might answer many of the questions that we raised in the 
introduction. 
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APPEND I A 6 



feat[0) 
feat[l] 
feat[2] 
feat[3] 
feat[*l] 

feat[5] 

feat[6] 
feat[7J 
feat[8] 

feet[9] 
fe«t[10] 
feat[ll j 

feat[12] 
reat[13] 
r«at[l4] 

feat[15] 
feat[l6] 
feat[17] 

feat[l8] 
feet[19] 
feat[26] 

feet[21] 
feet[22] 
faat[23] 

feat[2<l] 
feat[25] 
raat[26] 
f«at[27] 

feat[28) 
faat[29] 
f««t[3e] 

feat[3U 
feit[32] 
f«t(33] 

fett[35l 
fa«t[36] 
feat[37] 
feat[38] 

reat[39] 
r«at[40] 
feat(4l] 
feat[*2] 



relative site of ayabol 32*div_round (Xwidth . Ywid th ) 
nuaber of points 
nuober of strokes 
number of spaces 
nuaber of different levels in X 
number of different levels in Y 



for end of space 
for end of space 



nuaber of Ext X in neg.rot ^ 
different levels in X for oinX 
different levels In Y for ainX 

nuaber of Ext in X pos.rot 
different levels In X for oaxX 
different levels In Y for oaxX 

nuober or Ext in Y neg.rot 
different levels in X for ainY 
different levels in Y for einY 

nuaber of Ext In Y pos.rot 
different levels in X for naxY 
different levels In Y for eaxY 

nuaber of ExtXY for neg. rot 
different levels in X for feat 41 
different levels In Y for feat 4l 

nuaber of ExtXY for pos. rot 
different levels In X for feat M 
different levels In Y for feat W 

nuaber of arc parts 
nuaber of circle parts 
nuaber of X-levels in ayabol 
nuaber of Y-levela in ayabol 

nuaber of linear strokes (in_rot«»0) 
nuaber of poa. rot. strokes Jln_rot*»l) 
nuaber of neg. rot. strokes (in_rot»«7) 

nuaber of linear strokes where dir-0,1 

nuaber of linear strokes where dir-2.3 

nuaber of linear strokes where dlr-4,5 

nuaber of linear strokes where dlr*6,7 

nuaber. of strokes where out_rot*Q,l 
nuaber of strokes where out_rot»2,3 
nuaber of strokes where out_rot»**,5 
nuaber of strokes where out_rot«6,7 

nuaber of spaces where q*0\l 

nuaber of spaces where q*2,3 

nuaber of spaces where q**.5 

nuaber of spaces where q*6,7 
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feat[*»3] • number of spaces where out_rot»0.1 

feet[4t|] - nuaber of spaces where o%xt~rot»2,2 

feat[45] • nuaber of spaces where out~rot»4,5 

feat[46] - nuaber of spaces where out~rot» 6,7 

feat[*»7] - number of Bin X. 
feat[48] • number of max X. 
feat[*»9] • number of Bin Y . 
feat[50] • nuaber of max Y. 

feat[51] ■ sua length of spaces. 
feat[52] • relative position of spaces. 
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APPENDIX C 



# include <s tdio . h> 
#include <stdlib.h> 
#include <math.h> 
# include <conio . h> 
# include < values . h> 
^include <mem.h> 
# include < string • h> 
# include < process .h> 



#define GRID 15 

^define MAX NUM_0F POINTS 100G 
#define MAX_NUM_OF_STR0KES 64 
#define MAX NUM_0F_EXTREM0MS 32 
#define NUM~FEAT 53 
#define NUM SYMBOLS 72 
^define DIVISER 6 
#define TRUE 1 
#define FALSE 0 



typedef int boolean; 

struct TABLE_STR0KES_NEW { 

unsigned strk_num ; 

int delta_x ; 

int delta_y ; 

unsigned lenght ; 

unsigned pen_status ; 

int rotation ; 

}; 



struct POINT { 

unsigned x_cor : 10; 

unsigned y_cor : 10; 

unsigned pen_status : 4; 

}; 



struct TA9LE_EXTREM0MS { 



unsigned p_ndx 
unsigned x_cor 
unsigned y_cor 
unsigned pen_sts 
unsigned dir 
unsigned in_rot 
unsigned out_rot 
unsigned susp 
unsigned reserve 

); 



0; 
0; 



struct FEATURES { 

char IDfeat[llj; /• Id feature for naae V 
unsigned int f eat [NUM_FEAT] ; 

); 
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feat[0] 
feat[l] 
feat[2] 
feat[3J 
feat[4] 
faat(5] 

feat[6] 
feat[7] 
feat[B] 

feat[9] 

feat[10] 

featfll] 

feat[12] 
feet[13] 
feat[l4] 

feat[15] 
femt[l6] 
faat[17] 

feat[l8] 
feet[19] 
faat[29] 

feat[21] 
feat[22] 
faat[23] 

feat[24] 
feat[25) 
feat[26] 
faat[27] 

feat[28] 
fa»t[29] 

faat[32] 
faat(33] 

faat[353 
feat[36] 

faat[37] 
f"t(3«] 

f«*t[39] 
feat[4e] 
feat[4l] 
feat(42] 



ralativa else of ayabol 32 # div round(Xwidth. Ywidth) 
nuaber of pointa 
nuaber of atrokaa 
nuaber of spaces 

nuaber of different levels In X for end of space 
nuaber of different levels In Y f 0P cad of space 

nuaber of Ext X In neg.rot 
different levels In X for alnX 
different lavela In Y for alnX 

nuaber of Ext In X poa.rot 
different levels In X for aaxX 
different levels in Y for aaxX 

nuaber of Ext In Y no;. rot 
different levela in X for ainY 
different levela in Y for ainY 

nuaber of Bxt in Y poa.rot 
different levels in X for aaxY 
different levela in Y for aaxY 

nuaber of BxtXY for ne«/. rot 
different levela in X for feat 4l 
different levela la Y for feat 4l 

nuaber of ExtXY for pos. rot 
different levela in X for feat 44 
different levela in Y for feat 44 

nuaber of are parts 

nuaber of circle parte 

nuaber of X-levele in ayabol 

nuaber of Y-levela in ayabol 

nuaber of linear atrokas (in_rot- -6) 
nuaber of pos. rot. strokes Tin rot--l) 
nuaber of neg. rot. atrokas (in^rof -7) 

nuaber of linear atrokaa where dir-6,1 
nuaber of linear strokes where dir-2,3 
nuaber of linear strokes where dlr»4,5 
nuaber of linear strokes where dir*6,7 

nuaber of strokes where out_rot*0,l 
nuaber of strokes where out^rot'2,3 
nuaber of strokes where out_rot-4,5 
nuaber of strokes where out2rot«6»7 

nuaber of apacaa where q*G,l 

nuaber of spaces where q*2,3 

nuaber of spaces where q-4,5 

nuaber of spaces where q*6,7 
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reat[43] - nuaber of spaces where out_rot*G,l 

feat[44] - nuaber of spaces where out_rot*2,3 

fest[45] - nuaber of spaces where out~rot*<i,5 

feat[46] • nuaber of spaces where out~rot*6.7 

fesc[47] • nuaber of aln X. 

feat[<l8] - nuaber of aax X. 

feat[49] • nuaber of aln Y. 

feat[50] • nuaber of aax Y. 

feat[51] " bub length of spaces. 

feat[52] • relative position of spaces. 
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MAIN FOR TEACHING 



/• 

^include "main.h" 
#include "stdio.h" 
void aain( ) 
{ 

FILE *f_point ; 

struct FEATURES feat; 
struct FEATURES oin feat; 
struct FEATURES aax~feat; 

int featO; 
int first_feafl; 
int file_ndxl»2,file ndx2"0; 
char Ctemp[10]; * 

char Binfile[30].infUe[3O].minrile[3G].aaxfile[3O]; 
char SymId[il],BSyald[ll] ; LJ J ' 

/# l?!^!..! 1 ^!-?, 5 *" 0 ' 8 flle3 whlcn nold th « information of 

{ 



previous teaching # ^ 



FILE # PF; 

^ PF-fopen ("space"."*") ;fclose (PF); 

aystea ("del space*.*"); 
/•system ("del extra. out") ; 
aystea ("del f eat . out" ) ; */ 



»2S«2w«»«i» S containin * the X.Y.Pen of the symbol's examples 

********** * # •••/ 

strcpy Unfile, "\\vork\\sya\\sya" ) : 
strcpy (Syald, "aya") ; 

for ( f ile_ndxl -0 ; f lle_ndxl<NUM_SYMBOLS ; f ile_ndxl ♦ ♦ } 

itoa ( file_ndxl, Cteap. 10) ; 
strcat Unfile. Cteap) ; 
strcat (Syald, Cteap) ; 
strcat Unfile. "."); 
strcat (Syald."."); 

strcpy (Binfile.infile) ; 
strcpy (BSyald, Syald) ; 

file_ndx2-0; 

itoa ( file_ndx2. Cteap, 10) ; 
strcat Unfile. Cteap) ; 
strcat (Syald, Cteap) ; 
first feat-1; 
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while (transfora(iafile.*feat) l-G) 

strepy ( feat • IDf eat f SyaId) ; 

/•print features ( afeat, "feat .out" ); V 

if (flr9t_feet--l) { 

min_feat-feat; 

aax~feat-feat; 

first feat-©; 

} else 7* update ainiaua and eaxiaua feature according to feature 
of current symbol */ 

calc_liaits (M»in_feat) ,i(aax_feat) .feat) ; 

strepy (inf ile.Binfile) ; 
strepy (SyaId # BSy«Id) ; 
file ndx2*+; 

itoa~(file_ndx2,Cteap,ie) ; 
street (infile.Cteap) ; 
street (Syald.Cteap) ; 
) /• of while •/ 

strepy (ain f eat. IDf eat.BSyald) ; 
strepy (aax'f eet.IDf eat, BSyald) ; 

if (first featf-1) 
/• saves the ain feature and aax feature of the syabol to disk 
save_aln_aax <ein_feat.aax_feat) ; 

strepy (infile,"\\work\\sya\\aya») ; 
strepy (Syald. "sya" ) : 
} /• of for •/ 

exit (0); 

} 
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'include "Min.h" 

/• This procedure is to read the points of the sysbol fro* a file and 
fill it in the array of coordinates : arr cor. 

V 

int read points (struct POINT arr cor[],char 'filenaae) 
{ 

FILE *fpointer; 
unsigned int x t y,p; 

unsigned int prev_x ,prev_y ,prev_pen; 
unsigned int i«0 ( in»G; 

f pointer«f open ( filename f "r* ") ; 

prev_x»G ; 
prev_y«G ; 
prev_pen*G; 

while ( {fscanf ( f pointer . 'JEd %d Xd" . &x . ty v 4p) >G) 41 (p»»Q))« 
while (fscanf { Tpointer . **d %d ?d" . 4x. 4y , &p) > 9) 

if <in/DIVISEfl # DIVISER in) { 
in**; 

arr_cor[i] ,x_cor»x ; 
arr_cor[ i ] . y~cor«y ; 
arr_cor[ i ] . pen_s t a tus -p : 

if T((abs(prev~x-x)*aba<prev_y-y))>3) || (prev_pen I «p ) ) { 

prev_x»x; 
prev~y-y; 
prev pen-p; 

} 

) 

else in**; 

> 

arr_cor[i] . x_cor»arr_cor[i-l ] .x_cor; 
arr_cor[ 1] . y_cor»err_cor[ i-1 ] ,y_cor ; 
«rr_cor[i] . pen_s tatua-G : 

f close (f pointer); 
return (i): 

} 
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/• This eodule Includes general purpose 

(1) def_quart : a funtion that reeleves 
the quarter of these two nuebers In 

(2) div_round : a function to calcu" 
division of two integer nuebers 



procedures which ere : 
two nuebers , and returns 

~. - the range of 6-7 . 

a function to calculate the round nuaber of the 

a lntiffur nmhupi 



#inelude "aain.h" 



A funtion that recleves two nuebers f and returns the quarter of 
these two nuebers in the range of 0-7. 

lnt def_quart (x.y) 
lnt x; 
int yi 

{ 

If ((x>9 ) 41 (y«9)) return (0); 
if ({*>€> ) 44 (y>9) ) return (1); 
if <(x--9) 44 (y>e) ) return (2); 
if <(*<0 ) 44 (y>9) ) return (3); - 
if {(x<9 ) 44 (y--9J) return (4); 
if {<x<0 ) 44 <y<9) ) return (5); 
if {(x~9) 44 <y<9) ) return (6); 
if (<x>0 ) 44 (y<9) ) return (7); 
return (15); 

} 

/* ♦ 

A function to returns the round number of the division of two 
Integer nuebers. 

lnt dlv_round (lnt a, lnt b) 
( 

lnt 1-9; 

lnt teapl, tesjp2; 



teapl«a; 
teep2*b; 
e-abs(a) ; 

if (b— 9) return (MAXINT) ; 
whlle(a>b) 

{ 

If (b>0) a— b; 



else a*«b; 

if ((a*a>>b) 1**! 

If {((teepl>6) 44 (teap2>9)) || ((tespl<9) 44 (teap2<9))) 

return(l) ; 
else return (-1); 
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flacludo "aaln.h" 



calcualtes the space features of a syabol , (called froa 
calc_f eetures ) . 

* / 

void calc_space_feat (struct TABLE EXTRENOMS extr[],int extras, 

struct FEATURES Veat) 

( 

int i-0; 

boolean arr_x_levela[ 16] ; 
boolean arr2yllevels[l6] ; 
unsigned lnt sua«0: 

for (i-0;i<-15:i**) { arr x levels[i J-FALSB; 
arr_y levela[i]-FALSE: 

} 

for (i-e;i<extrasti** ) 

{ 

If (extr[i].pen ata--e) 
( 

(•feat) .feat[51]-(*f eat). feat[51]» 
( extr [ i ♦ 1 ] . p_ndx«extr [ i ] . p_ndx ) ; 
sue*«extr[l] .p adx; 
((•feat).feat[3J**>; 
arr_x_levels[extr[i*l].x_cor]-TRUE; 
arr~y~levele[extr[i*l].y~cor]-TRUB; 
switch (extr[i*l].dir) {" 

caae 6 : (*feat) . feat[39]** ; break; 

caae 1 : (•feat) . feet[39)** : break; 

caae 2 : (•feat ) . f eat[*»9] ; break; 

caae 3 > (*f eat) .*f eat[<ie J** ; break; 

case 4 : (*f eat) . f eat[4l]»* ; break; 

case 5 : (*feat) . f eet[4l]** ; break; 

caae 6 : ( # reat ) . f eet[*»2]** ; break; 

caae 7 : ( # feat ) .f eat[42]»* ; break; 

default: break; 

> 

> 

(•feat) . feat[52]-dlv_round(8*sua 9 (*feat) .feat[l]) ; 

for (i-9:l<«i5ii**) { 

if (arr x levels [1]"*TRQE) ( ( <*f eat ) . feat[t ] ) ♦ ♦) ; 
if <arOTleveleCi]"TRUI) ( ( ( # faat) .feat[J])~) i 
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calcualtes the rotation features of a syibol , (called froa 
calc features ) • 



void calc rot (struct TABLE_EXTREMOMS extr[].int extras, 
struct FEATURES Teat) 

{ 

int 1; 

for <i-l;i<-extras;i**> ( 
switch (extr[i].in_rot) { 
case 0 : { 

( (Teat) .feat[2B])**; 
switch (extr[i].dir) { 
case 0 t (Teat) .feat[31]**;break: 
case 1 : ( T eat ). feat[31 ]♦♦: break : 
case 2 : (Teat) .feat[32]**;break; 
case 3 : ( Teat ) . feat[32]** ;break ; 
case 4 : ( # f eat ) . f eat[333** :break ; 
case 5 : ( # feat) . feat[33]** ;break: 
case 6 : ( •feat) . feat[3 1 » ]♦♦: break; 
caae 7 : (*feat) . feat[3^]** :break; 
default: break; 

) 

case 1 : ( (Teat ) . feat[29] ) ♦♦ ; break; 
case 7 : ( ( Teat ) . f eat[3©] ) : break; 
default: break ; 



if ( (extr( i-1] .pen_ats»extr[i] .pen_ats)--2) 



switch (extr[i].out_rot) { 
caae 0 : ( # f eat ) . f eat[35]** i 
caae 1 : (Teat) . f eat[35J** i 
caae 2 : Cfeat ). feat[ 36]* • i 
case 3 : (Teat ) . f eat[36]** : 
caae H ; (T eat ) . f eat[37]** : 
caae 5 : (Teat ) . f eat[37]** : 
case 6 : Cf eat ) . f eat[38]~ : 
caae 7 : Cf eat) . f eat[3S]** ; 
default: break; 

} 



break ; 
break ; 
break ; 
break ; 
break ; 
break ; 
break; 
break; 



) 

i r "( ( extrl i - 1 ] . pen_e ts *ex t r[ i ] . pen_s ta ) • - 1 ) 
. switch 4extr[i].out_rot) 



< 



caae 0 
caae 1 
caae 2 
case 3 
caae 4 



Cfeat). feat[43]**i 
(•feat). feet[*3]**; 
(Teat) .featC**]**; 
(•feat). feat[<t *]♦♦; 
(•feat) .feet[45]**i 
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case 5 : ( # faat) . f aae[*5]*»; 
case 6 : ( # feat) . feat[t»6]**; 
case 7 : ( *feat ) . f eat[16]** ; 



' calcualtes the extreeua type features of a syabol, 

(called froa calc_f eatures ) . ••••••< 

void calc ext types (struct TABLE EXTRENOMS extr[],int extras, 

struct FEATURES # faat) 



{ 



Int i-0; 

boolean arr_x_levels[ 16] ; 
boolean arr~y_ievels[ 16] ; 

for (i-e;i<-15:i**) { 
arr x levels [ i ] -FALSE ; 
arr~y~levels[i]-FALSB; 

) 

for (l-l;l<extras;i**) 



If 

( 



j(eatr[i].dir«3)tt((«*tr[fl).dir«-l) || <extr[ 1*1 ] .dir«3) ) ) 
(extr[i).dir--7)ii((a*tr[i»l].dir--5) I I (extr(i*l ] .dir«6> ) ) ) 



if ((extr[i-l].pen »te*extr[i] .pen_ats)—2) 
(•feat) .feat[6]**; 

) 

»•*•••••• • / 

for (i-0;i<-15:i**> { 
arr x levels[l]-PALSE; 
ar r~y~lavele [ i ] -FALSE ; 

) 

f0 If ( }jlextr[o"i^ II ("trCfil.dir.-6m 

! «xtr[i].dir.-3)it((«tr[i*l].dir.-l) I I <extr[i*l ] .dir-2) ) > 

(extr[i].dir"5> ii <extr[i*l]. dir-.l) j | | 
<<extr[i).dir«3) ii (axtr[i*l) .dir-7) ) ) 

1 if ((extr[i-l].pen_sts*extr[i].pen_eta)"2) 

{ arr x levels[extr[i] .x_cor) - TRUE; 
»rr~y~lavels[extr[i].y_cor] • TRUE; 

} 

} 
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for (i»e:i<-15;i**) { 

if (arr x levelsj i ]--TRUE) ( ( (*feat) . feat[7]) ♦♦) * 
if (arO~lavala[i]--TRUB) (((•faat).f#at[8])**) ; 



for (i-e;i<-15;i**) { 
arr_x_levela [ i ] • FALSE ; 
arr'y lavala(i]«FALSE; 

} 

for (i«l:i<extr«a;i**) 

if | j(e*tr[i].dir— l)At((extrfi*l].dip«3) II («xtr[l«l] .dir»2) ) ) 

((extr[i].dir--5)44(U*tr[i*l].dir~o) || (•xtr[i*X ] .dir--7) ) ) ) 



{ 



if ( (extr(i-l].pen_ata*extr[i] .pen_«t«) «»2) 

({•fe«t).feat[9]**); 
arr_x_levela[axtr[i].x cor] ■ TRUE; 
arr_y"levela[axtr[i].y~cor] - TRUE; 



for (l-0ii<-15;i**) { 
arr_x levele[ i ] -FALSE; 
arr_y_levela [ i ] -FALSE ; 

) 

for (i*l;i<axtraa;i**) 

if j(«tr[i].dir«7)44((axtrti*l].dir— 5) II (•xtr[fl] ,dir«6) ) ) 

|axtr[i].dir--l)44((axtr[±*l].dir--3) II <«tr[i*l] .dir«2) ) ) 

(extr[i].dir— 1) 41 <e*tr(i*l] .dir— 5) ) || 
(extr[i]-d:ir—7) 44 (axtr[i*l] .dir«3) ) ) 
{ 

if ( (extr[i-l].pan a ta*extr[i] . pen ats)«-2) 

{ 

arr_x_lev«la[axtr[i].x_cor] • TRUE; 
arr~y~lovela[axtr[i].y~cor] • TRUE; 

} 

> 

for (i«9ji<-l5;i**) { 

if (arr x levels [ i] --TRUE) ( ( ( # feat) . feat[19] >♦♦) ; 
if (arr y leveli[i ] --TRUB) ( ( (*fe»t) . f e«t[ 11 ] ) ) ; 

) 

/ / 
for (i-0;i<-15ii**) ( 
arr x le*ela[ i ]»PALSB ; 
•rr"y~le»ela [ 1 ] -FALSE ; 

> 
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for (i*l;i<*xtras;i**) 

if j{<axtr[i].dir-. 5)U(l«tr[iM].dif-3) || <e*trU*l ) .dir«<l ) ) ) 

^ <<extr[i].dir--l)4t<(extr[i*l].dir«7) || («xtr[i*l] .dir«0) ) ) ) 

if ( (extr[i-l] .pen s ta*extr[i] .pen sts)*-2) 
(•feat) .feat[i2]**; 

} 

for (i-9;i<-15:i**) { / 
arr x levels[i] - FALSE; 
arr"y~level»[i]*FALSB; 

} * 

for ( i-1 ; i<extras ;i**) 

if U{extr[i].dir— 7)ti((extr[i*l].dir— 1) || (extr[i*l] .dir— 6) ) J 

extr[i].dir--5)"Uextr[i*l].dir«3) II <extr[i*l] .dir»«4) ) ) 

((•xtr[i].dir«5) 44 (extr[i»l ].dir—l) ) || 
{(extr[i]*dir-«7) .14 (extr[i*l ] -dir— 3) ) ) 

if ( (extr[ i-l].pen_«t§*extr[i] ,pen_«ta)--2) 



arr_x_levela[extr[i] .x_eorJ • TRUE; 
arr_y_laveli[extr[i] .y~eor] • TRUE; 



) 



for (i»0;i<-15;i*») { 

if (arr_x Xevei«[i]»-TRUE) ( ( Cfeat ) . feat[ 13] ) ) ; 

if (arr_y_levela[i]«TRUB) ( ( ( # feat) . feat[l*J ) ♦ ♦) ; 

) 



for (l«e;K*15;l + *) ( 
arr_x l«v«i»[ i ] -FALSE ; 
arr y~lav.l»[ i J-PALSB ; 

) 

for (i-1 ;±<axtra«;i**) 

ir j j(amtr[i).dir« 3 ) 44<(a*tr(i*l] .dir« 5) II 

( (axtr[l].dlr"7)44( ( extr[i* 1 ] .dir»l ) | | 

( 

If (<extr(l-l].pao et»«axtr[i] .pan_sta )»*2) 
< # feaU.faat[15]**; 

) 



(•xtr[i*l].dir--4))) 
(•xtr[i*l].dir--e)))) 



r 



for (i-9;i<-15;i**) { 
arr x laval»[ i ] -PALSE ; 
arr y~lavala[ i]-PALSB; 

} 
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for (i«l:i<extr«s:i**) 

if j (<axtr[i].dir~l)iM(axtr[i*l].dir"7) II I extr[i*l ] . dir«»0) ) ) 

j (extrti).dir— 3)t4( {extr[i*l ] . dii-«5) | | («xtr( fi ] ,dit—<» ) ) ) 

( (extr[i].dir--l) LL ( extr[ i ♦ 1 ] . dir-»5 ) ) || 
( (extr[i].dir--3) &t {extr[ i*i] . dir«-7) ) ) 

( 

if ( (extr[i-l] .pen s ta*extr[i ] . pen_s ta ) «"2 ) 

{ 

arr_x_levels[extr[i] ,x_cor] • TRUE; 
arr~y~levels[extr[i] .y"cor] - TRUE; 

) 

} 

for (i-G;i<»15;i**) ( 

if (arr x_levels[ i]*«TRUE) ( ( ( »f eat ) . f eat[l6 ] ) ♦ ♦ ) ; 
if (arr_y_levels[i]"TRUE) ( ( ( # feat) . feat[17] ) ) ; 

} 

' * v 

for (i-0;i<»15:i**) { 
arr x leva 1 s [ i ] -FALSE; 
arr~y~leveis[i]-FALSE; 

> 

for (i-1 r i<extras ;i** ) 
if (extr[i].out rot--5) 

{ 

if ( (extr[i-l] .pen eta*extr(i) .pen at»)"-2) 

{ 

{•faat) .feat[lB]**; 
arr_x_levela[extr[i ] .x_eor] - TRUE; 
arr~y~levela[extr[i] .y~cor] • TRUE; 

} 

} 

for (i«G;i<-15;i*») { 

if (arr x_levels[i]"TRUE) ( { (»feat ) . feat[ 19]) ♦♦) ; 
if <arr~y_levela[i)*-TRUE) ( ( (*f eat) . f eat[29] ) ) ; 

) 

/•••• / 

for (i-9;i<-15;i**) { 
err_x_le vela [ i ] • FALSE ; 
arr y levela[l]-FALSE; 

) 

for (i«l;i<extraa;i+*) 

if ((Mtr(i).out rof3) II (extr[i) •out.rot*-*) ) 

{ 

if ( (#xtr[i-l].pen eta*oxtr[i J .pen_ata)«2) 

{ 
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<*reet) .feat[21]**; 
arr_x_levela[extr[i].x_cor] • TRUE; 
err~y~levels[extr[i].y corj • TRUE; 

} 

) 

for U-Q;K-15;i**> { 

if [arr x levela[i]--TRUE) { ( ( # f«et) . feet[22] ) ♦ * ) : 
if (arr~y~levels[i]--TRUE) ( ( ( # feat) . feet[23J) *♦) ; 

) 

) 



caleualtes the arc features of a syabol. 
(called froa calc features)* 



void calc area (struct TABLE EXTRBNONS eztr[],lnt extras, 
struct FEATURES •feat) 

{ 

int i-0: 
iat J-0; 

while (Kextraa) 

1 if ((extr[i].in rof-7) I I <extr[i].in rot— 1)) 
( 

( ( # feat) ,feat[24])**; 

while ((extr[i].in rot«7) II <extr[i].in rofl)) i**; 

) 



i-0: 

while (i<extree) 

{ 

if <extr[i].in rof-7) 
I 

J-i: 

while (extr[l].in rof »7) {J**:i**;> 
) else if <extr[i].in_rot— 1) 

{ 

J-i: 

while (extr[i].in_rof -1) {J**;i**;} 
\(Veat) .feet[25])-(< # re*t>.fset[25])Mint)(j/4); 

) 

) 
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Z 1 



calculates the levels features (auaber of dlufferent levels) of • 
syabol 

(called froa calc_f eatures ) . 

* * / 

void calc syabol levels (struct TABLE EXTREMOHS extr[].lnt extras, 

struct FEATURES Teat) 



{ 



Int 1-3; 

boolean arr_x_levels[ 16] ; 
boolean arr~y~isvele[i6] ; 

for (i-e;i<-15;i**) < 
-arr.x.l eve la [ i ]■ FALSE i 
arr.y.le vela [ i ] -FALSE ; 

} 

for (l»e;i<«extras;l*+) 

{ 

arr_x_levela[extr[i] .x_cor] - TRUE; 
arr y~levela[extr[l] . y~cor] • TRUE; 

} 

for (i-e;i<-15;l**) ( 

if (arr x levels[i]--TRUB) ( ( ( # f tat) . f eet[26]) ; 
If (arr y~levele(ij« TRUE) ( ( ( # f eat ) . feat[27] )♦♦) : 

) 



calculates the nuaber of alnuauas/aaxiauas in X and Y. 
(called froa calc_features ) . 

void calc dub alnaax (struct TABLB.BXTRENOMS extr[],lnt extras. 

struet FEATURES *feat) 

{ 

lat 1; 

for (l»l;Kextrae;l+*) 

( 

If ( (extr[i-l].pen sts*extr(i] .pea sta)--2) 

< 

if (((extr[i).dir--5)tI((extr[i*l].dir-« 7) II 
(extr[i*l].dir«6))) || 
((extr[i].dir"3)tt((e*tr[i*l].dir--l) | | 
(extr[i*l],dlr— 2))) || 

((extr[l].dlr— 5) It <extr[i*l] .dir--l>) || 
((extrtl].dir—3) tt (eatr[i*l] .dir«7> ) ) 
(•faat).feat(47]»*S 

if <((extr[i].dir--7)tt((extr[i^l).dir~5) II 
(extr[i*l).dir— 6))) || 

l(extr[i].dir— l)4t( (extr[i*l].dir« 3) II 
<extr[i*l].dir—2))) || 

<(extr[i].dir«l) it (eatr[i*l] .dir— 5) ) II 
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((extr[ij.dir~7) LL <extr[W] .dir— 3) ) ) 
(•feat) .feat[*8]^; 

if ( (<extr[i].dir--7)U< (extr[i*i J .dir--l ) || 
(extr[i*X).dir«e))) || 
( <extr[i].dir«5>«< (extr[i*l] .dir«3) 1 1 
(extr[i*l).dir--<*))) || 

{(extr[i].dir»*5) « <extr[i*l] .dir--l ) ) || 
(<extr[i].dir--7) (extr[i*l] .dir--3) ) ) 
.(•feet).feet[49J**; 

if ({(extr[i].dir--l)**((extr[i*l).dir--7) II 
(extr[i*l].dir--G))) || 

( (extr(i].dir--3)*M<extr[i*l].dir"5) II 
(extr[i*l].dir-»4)) ) || 

( (extr[i].dir--l) it (extr[i*l ] .dir— 5 ) ) || 
( (extr[i].dir--3) M (extr[i»l].dir«7))) 
(•feat).featt50]**; 



> 

} 

>. 



calculates the features of a sysbol depending on the extreauns of 

that syabol . and fills in the structure variable: feat. 
»»«•••••«••«••»••••»•«••••••♦••*•••••••••••«•••••••»«•••*••••»•••••••/ 

▼old calc featurea (struet PBATURBS *feat.int points. 

struct TABLB.BXTRBNONS extr[], 
lnt extras, in t feate) 

( 

lnt 1; 

/• initialixation •/ 

for (i-0;i<NU*_FBAT;i**) (*feat ) .f eat[i]»0; 

(*feat).feat(0] ■ feate ; 
(•feet).feat[l] ■ points ; 
(•feat) .feat[2] • extras ; 

calc space.feat (extr.extrae . feat) j 
calc'rot Textr. extras, feat) ; 
calc~ext_typee (extr, extras , feat) ; 
c*le~aros (extr, extras . feat) ; 
cale'tyabol.levels (extr .extras . feat) ; 
calc'nua alnaax (extr, extras , feat) ; 

) 



) 
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/• This aodule la for calculating and aanlpulatlng extreauaa . It 

include* four procedural : 

(1) calc_extreaues : To find the extreeuas of the ayabol , and 
the "change In pen" polnta. 

(2) flnd_aax_extre : To find the aax/aln X-coordlnate and the 
aax/aln Y-coordlnate of the ayabol. 

(3) analyse_extreauee : A procedure to analyaa the extreauaa found 
so far, aalnly thla procedure aarka cloee extreauaa aa 
•uapecloua extreauaa. 

(4) conv21evala : Replaces the actual coordinates of the 
extreauaa in err w extroauaa with the levels of these coordinates 
by doing quantisation* (there are 16 levels). */ 

/Include "aaln.h" 



The Input of this procedure la the array of coordinates which holds 
the coordlnataa of the ayabol ♦ and the nuaber of these points , It 
fills tha special of polnta (i.e. , extreauaa or change in pen) In 

the array 

arr_extreauas v it returns the nuaber of special polnta It found. 



Int celc_extreaoee (struct TABLS_BXTRBMOIIS err_extreeoas[ ] . 

atruct POINT arr cor[ ] ,int~nua of polnta) 
{ ~ 

unalgned lnt IndB; 

unalgnad lnt ndx; 

unsigned pen_vas_upt 

int crnt_quart t prev_quart; 

lnt crnt_rot,prev_rot; 

lnt Sx,Sy,PSx,PSy7a,b; 

lnt firat_polnt«li 

lnt Pndx*6; 

unsigned lnt LastNdx; 

int i; 

lndB«6i 

ndx«8; 

pen_was_up*l ; 

Sx»§; 

SyO; 

PSx»0; 

PSy-Gi 

a-9;b«9i 

while (ndx<nua of polnta) 
{ 

while ( Carr cor [ndx] .pea_etetus)"l) 

{ 

if (p«n_wat_up**l) 
( /* beginning axtreaea */ 
If (firat_polat»l) 

lat tSx.tSyt 
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Sx» ( arr_cor[ndx*l ] . x_cor-arr_cor[ndx] . x_cor ) ; 

Sy« ( arr_cor[ndx*l] . y_cor-arr_cor[ndx J . y_cor ) ; 

tSx* ( arr_cor[ndx*2] .x_cor-arr_cor[ndx*l ] .x^cor) ; 

tSy- ( arr_cor[ndx*2] .y_cor-arr_cor[ndx*l ] .y'cor) ; 

a-Sx # tSy-Sy*tSx; 

b-Sx # tSx*Sy # tSy; 

PSx»Sx; 

PSy»Sy ; 

} 

else { 

/• for the previous ENDING extreaoa •/ 

Sx» ( arr_cor[ndx] -x_cor-arr_cor[Pndx] . x_cor) ; 

Sy« ( arr"cor[ndx] .y_eor-arr_cor[Pndx] .y_cor) ; 

PSx» ( arr_cor[Pndx] . x_cor-arr_cor[ Pndx- 1 ] . x_cor ) ; 

PSy»( arr_cor[Pndx] .y_cor-arr_cor[Pndx-l] .y_cor) ; 

a«PSx # Sy-PSy # Sx; ~ 

b-PSx # Sx*PSy # Sy; 

arr_extreaoas[indE] .p_ndx-Pndx; 

arr~extreaoaa[indE] .x_cor»arr_cor[Pndx] .x_cor ; 

arr~ex t reaoas [ IndE ] . y~cor- arr~cor[ Pndx ] . y~cor ; 

arr~ex treeoaa [ IndE] • pen_s ts-9 ; 

arr~ex t reaoas [ IndE] . dir»def _quart ( PSx , PSy ) ; 

arr~extreaoas[indE].out rot-def quart(b,a); 

{ 

int PPSx.PPSy; 

PPSx* (arr_cor[Pndx-l] .x_cor-arr_cor[Pndx-2] .x_cor) ; 
PPSy- ( arr cor [ Pndx-1 ] . y~cor-arr_cor[Pndx-2 ] • y.cor ) ; 
a«PPSx*PSy-PPSy # PSx; 
b-PPSx # PSx*PPSy # PSy; 

arr extreaoas[ind8].in_rot»def_quart(b,a) ; 



indE** ; 
PSx-Sx; 
PSy«Sy; 
{ 

Int tSx.tSy; 

Sx-(arr_cor[ndx*l] .x_cor-arr_cor[ndx] .x_cor) ; 
Sy«(arr~cor[ndx*l] .y~cor-arr_cor[ndx] .y_cor) ; 
tSx-Carr cor[ndx] •x_eor-arr_cor[Pndx] .x_cor) ; 
tSy-(err~cor[ndx] .y~cor-err_cor[Pndx]«y_cor) ; 

a»tSx # Sy-tSy # Sx; 
b»tSx # Sx*tSy # Sy; 

} 

crnt_quart-def_quart(Sx,Sy) ; 
crnt rot-def_quart(b,a) ; 

arr extreeoaa[indE].p_ndx«ndx; 
arr'extreaoasCindEl.x.cor-arr^corCndxJ.x^cor; 
arr~extreaoas[indE].y_cor-arr_cor[ndx] .y.cor; 
arr%xt reaoas [ indB] . pen_s ts-1 ; 
if (first poinf-1) { 

arr extreaoaa[indE] .dir-15 ; 

arr"extreao«s[indE].in_rot-15; 

arr^extreaoBsCindEl.out^roflS; 
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ndx**; 

first point-6; 

) 

else { 

arr_extreaoea[indE] .dir«def_quart(PSx,PSy) ; 
arr_extreaoas[indE] .in_rot«§: 
arr~extreaoas[indE].out rot»def quart(b.a); 
> " 

pen was up*©; 
) elae~{ 

crnt_quart«def_quart(Sx.Sy) ; 

ernt~rot»def_quart(b,a) ; 

if (T (crnt_quartt*prev quart) || 
(<crnt_rot>-4) 4a (prev_rot<4) ) || 
((crot~rot<4) 14 (prev rot>-4)) 

) 

U (prev_rotl-15)) 

{ /* regular extreaoa */ 
if <(aba<Sx)>G) 44 (aba(5y)>0) || (b<0)) 
{ 

if ((ftdx-l-arr extroaoaa[indB-l] .p ndx)>G) 
( 

arr_extreeoaa[lndE] *p_ndx«ndx-l ; 
arr_extreaoas(indE] .x_cor»arr_cor[ndx-l] .x_cor; 
arr_extreaoas[lndK] .y_cor»arr_cor[ndx-l] «y_cor; 
arr_extreaoea[indE] .pen_ste*l; 
arr~extreaoas(indB] . dir«prev_quart ; 
arr_extreaoas[ IndE) . in_rot*prev_rot ; 
err~extreaoaa[ladB] .out_rot«crnt_rot ; 
indl"; 

) 

) 

) 

) 

ndx*+ t 

Sx»(arr_cor[ndx] .x_cor-arr_cor[ndx-l] ,x_cor) ; 

Sy" (arr^cortndx] .y_cor-err_cor[ndx-l] .y_cor) ; 

a«PSx*Sy-P3y*Sx; 

b-PSx # Sx*PSy # Sy; 

PSx*Sx; 

PSy»Sy; 

pre*_quart»ernt_quart : 
prev rot«crnt_rot; 
) /• end of while ( arr_cor[ndx] .penstatuf»l ) •/ 
if .( (pen_waa_up«-e) 44 (arr_cor[ndx-l].pen_atatua**l)) 
{ /• ending extreaoa */ 
Pndx*ndx-1 ; 
pen vaa up»l; 
Lastlldx*ndx-1; 

> 

ndx**» 

} /• ndx<-«u»0fPoints •/ 
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/* Add the last special point to the array •/ 
arr_extreaoas [IndE] . p_ndx*Las tNdx ; 
arr_extreaoas[lndE].x2cor»arr_cor[LastNdx].x cor; 
arr_extreaoas[indE].y_cor*arr2eor[LastNdx] .y'cor; 
arr_extreaoas [IndE]. pen .sts-oT 

Sx«7arr_cor[LastNdx-l].x_cor-arr_cor[LaatNdx-2].x cor) ; 
Sy ( arr_cor[LastNdx-l ] .x_eor-arr~cor[Laa tNdx-2] .x'cor) ; 
PSx- ( arr_cor[ Laa tNdx-2 ] • x_cor-arr_cor( Las tNdx-3] .J cor ) ; 
PSy» (irr_cor[ Las tNdx-2 ] .y_coftrr_cor[ Las tNdx-3] .y~cor) ; 
arr extreeoas[lndB] .dir-def quartlSx.Sy) ; 
a-PSx # Sy-PSy # Sx; 
b-PSx*Sx*PSy*Sy; 

arr_extreaoas[lndB] .ln_rot*def_quart(b, a) ; 
arr_ex treaoas [ IndE] . out_ro t* 15T 

return (IndE); 

) 



This procedure is to find the aax/ain X-coordlnate aad the aax/ain 

Y-coordlnate of the syabol. 



void find_aax_extra (struct TABL8_EXTREN0MS arr_extroatoas[] , 

int nua_of_extras,lnt 'Xaln.int *Xaax. 
lat *Yain,int # Yaax) 

{ 

unslrnad Int 1*0; 

•Xaln-1260; 
# Xaax«G; 
♦Yaln-1299; 
•Yaax-0; 

while (K«nua of extras) 

< 

if (arr_extreaoaa[i] .x_cor<*Xain) # Xaln»arr_extreaoas[l] . x_cor ; 

if (arr_axtreaoaa[i] ,x~cor> # Xeax) *Xeax»arr~extreaoas[i ] .x~cor; 

if (arr_extreaoas[l] .y~cor< # Yaln) *Yaln-arr~extreaoas[l] .y^eor; 

if ( arr~extraaoaa[i] .y~cor> # Yeax) *Yaax«arr~extreaoas[l ] . y~cor; 

) 



/ 

correct dlr ,ln_rot,out_rot for auspicious points , called froa 
analys6_extreauas 

* / 

void correct extra (struct POINT arr cor[], 

struct TABLB.EXTREHONS extra[], 

struct TABLE BXTREMOMS arr_exe extra[], 

int i.int PiTlnt J) 

{ 

int Sx 9 Sy ,PSx,PSy; 
int ndxl 9 ndx2; 
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Int a,b; 

ndxi -extra [Pi ] . p_ndx ; 
ndx2-extrn[i] .p ndx; 
if <Pi>0) 
( 

if (extra[Pi-l].pen sts-"0) 

{ 

PSx-arr_ccr[ndxl].x_cor-arr_cor[extra[Pi-l].p n dx].x cor- 
^ PSy«rr_cor[ndxlJ.y_cor-arr w cor[8xtr»[Pi-i]. P 3ndx].y2cori 

else ( 

PSx-arr_cor[ndxl].x_eor-arr cor[ndxl-l] .x cor; 
^ PSy-arr_cor[ndxl].y_cor-arr2cor[ndxi-l].y~ C or; 

) else {PSx«0;PSy*0; ) 

Sx»arr_cor[ndx2].x_cor-arr_cor£ndxl].x_cor; 
Sy-arr_cor[ndx2].y_cor-arr2cor[ndxl].y2cor; 
a«PSx*Sy-PSy*Sx; ~ 
b«PSx # Sx*PSy # Sy; 

if (arr_exc_extrn[ J-l].out_rotl -15) 

arr_exe_axtra[ J-l] .out_rot-daf_quart (b, a) ; 

PSx-Sx; 
PSy»Sy; 

arr_exc_extra [J]. dlr-def _quart ( PSx , PSy ) ; 

arr_«xc_extra[ J ] . in_rot-0; 

if Tarr~axc extra[JJ.ogt rotl-15) 

{ 

if (axtra[i].pan rta--0) 

< 

Sx-arr_cor[extre[i*l] ,p_ndx] .x_eor-arr_cor[ndx2 ] .x cor; 
Sy-arr v cor[axtra[i«l] .p w ndx].y v cor-arr^eor[ndx2] ,y~cor; 

elsa 

{ 

Sx-arr_cor[ndx2*l] .x_cor-arr_cor[ndx2] .x cor; 
Sy-arr_cor[ndx2*l] •y2eor-arr~cor[ndx2] .y~cor; 

a-PSx*Sy-PSy*Sx; 
b-PSx*Sx*PSy*Sy ; 

arr axe extra(J].out rot-def quart(b.a); 
> " 

} 

/ # 

A procedure to analyaa the extreauaa found ao far , aainly this 
procedure aarka cloaa axtraauas aa auspecioua axtraauas. 

* • # / 
int analyaa axtraaoaa (struct POINT arr cor[], 

atruct TABLB_EXTRBMOMS axtra[], 

•truct TABLB^EXTRBHOHS arr_exc_extra[ ] , 

int nui of axtraa) ~ 

{ 

int i.J»0; 
int count-©; 
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int Pi-9: 

boolean FirstP-TRUE; 

for ( i»l ; Knua_of_extra3 ; ) 

if ( ( (extrm[i].x_cor-extrm[i*l] ,x cor)<2 || 
(extra[i].y_cor-extro[i*l].y cor)<2) 44 
(extrB[i].in_rot!«extra[l*l]7in_rot) 44 
(extra[i] .dir«extra(i*l] .dir) 44 
(extra[i] .pen_sta--l ) 44 

<extrm[i-l].pin_3tsl-0) ) extra[l] .susp-1 ; 
^ else { extra[i] .susp-Q; count** ; } 

extra[0] . suap*€); 
extra[i].susp"G; 
/•count**;*/ 



for (i-0;i<»nua_of_extras;i**) 



if ( extra[i] , 9U3P--0) { 

arr_exc_extra[J] . p_ndx-extra[i] .p ndx; 
arr_exc_extra[ J ] . x_cor-extra[ i ] . x~cor ; 
arr_exc_extra[ j ] . y_cor-extre[ 1 ] . y^cor ; 
arr_exc_extra[J].pen_Bts-extra[i]7pen st»; 
arr_exc_extra[ J].dir»extra[i].dir; 
arr_exc_extra[ J ] . in_rot -ext ra[ i ] . in_rot ; 
arr_exc_extra[j].out rot-extra[l] .out rot; 
if ( Fi rs tP ■ • FALSE ) 
{ 

correct_extra { arr_cor , extra , 
arr exc_extra , i , PiTj ) ; 
FlratP-TRUE; 

) 

if (extra[i].pen sts--0) FirstP-TRUE; 

) 

else { 

if (PirstP) Pi«i-1; 
FirstP-FALSB; 

) 

} 
{ 

/•FILE # fp; 

f p'fopen ( "extra. out* t "ab*" ) ; 

for ( i«6 ; i< "count ; i** ) 

{ 

fprintf (fp,"Xd %& %& %d %& %d $6 \n", 
arr_exc_extra[ i ] . p_ndx „ arr_exc_extra[ i) . x_cor , 
arr_exc_extra[ i] .y_cor , arr7*xe_extra[l) . pen_«ts f 
arr_exc_extra[i] .dir. arr_exc_extra[i] .in_rot , 
arr exc extra[i],out rotj; " " 

T 

fprintf (f Pf \n m ) ; 

fclose (fp); # / 
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) 

return (count); 

> 

/ 

Replaces the actual coordinates of the extreauas In arr extreauas 
with the levels of these coordinates by doing quantisation , ( there are 
16 levels). it also calculates featO : i.e. the relative size of 
syabol-32'dlv round(Xwidth, Ywidth) . 



void conv21evels (struct TA8LE_EXTREM0MS err_ex traaoas[ ] , 

lot nua of extras ,lat 'foatoj ~ 
{ " " 

int x_width,y_width; 

lnt Xain,Xaax7Yaln. Yaaxj 

int l«6s 

f lnd_aax_extra (err_extreaoas »nua_of_extras •tXal&« &Xsex,4Yaln,lYaax} ; 

x_wldth a Xaax-Xaln; 

y~width-Yaax-¥ain: 

while (K*mia of extras) 

{ 

arr extreaoaa[i] .x cor-div round! (arr extreaoaafl] *x cor* 

Xein) # ORID,x_width); 
arr extreaoas[l] .y cor«dlv round ((arr extreaoas[l] .y eor- 

Yaln) # QRID,y width); 

> 

( # faate)-div round ( 59 •« width, y width); 
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linclude "■•in.h" 



void print_features (struct FEATURES Veat.char filenase[]) 

FILE # fp; 
lot 1; 

fp a fopen ( filename . *ab* ") ; 

/•fprintf (fp f "naae of syabol -*s\n" , ( # f eat) . IDfeat ) ; 
fprlntf (fp,"size of syabol -Xd\n" , { # f eat ) . f eatO) ; 
fprintf (fp, "number of points •ZdVn* . ( # f eat ) . featl) ; 
fprintf (fp. "number of gtr -2d\n" . ( *f eat ) . feat2 ) ; 
fprintf (fp»"nuaber of spaces -*d\n" f ( # feat) . feat3) ; 
fprintf (fp, "nunber of diff. levels in X for end of 

space-*d\n" , ( # feat) . feat*» ) ; 
fprintf (fp,"nuaber of diff. levels in Y for end of 

space-*d\n" , ( # feat) . featS) ; 
fprintf {fp, "number of spaces for q<* **d\n" , ( # f eat ) . feat6) ; 
fprintf (fp, "nunber of spaces for q>«4 «Xd\n" , ( # f eat) . f eatB) ; 
fprintf (fp,"nuaber of spaces ro<H 

•*d\n", (Veat) .feat73) ; 
fprintf (fp. "number of spacos ro>-4 

•*d\n",Cfeat).feat75); 

fprintf (f p. "number of linear strokes 

•*d\n", ( # feat) .featlO) ; 
fprintf (Tp, "number of linear strokes where dlr<4 

•*d\n",(*feat).feat69); 
fprintf (fp t "nuabar of linear strokes where dlr>«4 

•*d\n",( # feat).faat71); 

fprintf (fp, "nunber of strokes with pom. rot 

-*d\n".( # feat).featll); 
fprintf (f p. "number of strokes with neg.rot 

•Jd\n" t ( # feat).foatl2); 

fprintf (fp, "number of strokes ro<U 

•Zd\n" f < # feat).featl3): 
fprintf (fp, "number of strokes ro>-4 

•*d\n" f < # femt).featl5); 



fprintf (fp, "nunber of Ext In X neg. rot. 

•*d\n",( # feat) ,featl7) ; 
fprintf (fp,"diff. levels in X for alnX 
fprintf (fp,"dlff. levels in Y for alnX 

fprintf (fp,"nuaber of Ext in X pos . rot. 
fprintf (fp.'dlff. levels in X for naxX 
fprintf (fp.'diff. levels in Y for aaxX 

fprintf (fp, "number of Ext In Y neg. rot. 
fprintf (fp t "difr. levels in X for alnY 
fprintf (fp t "diff. levels in Y for alnY 



»*d\n" t ( # feat) .featlS) ; 
■Xd\a".( # feat).featl9); 

■Xd\n", (•feat).feat20); 
■Xd\n" # ( # feat).faat21); 
■Xd\n".(»fmat).feat22); 

■XdXn*. ( # feat),feat29); 
■Sd\n",( # feat).feat3Q): 
■*d\n", ( # feat).feat31); 



fprintf (fp, "number of Ext in Y pos. rot. «*d\n" , (*faat ) . f eat32) : 
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fprintf (fp."dlff. levele In X for aexY »*d\n" # ( •Tmmt) . foat3J) ; 
fprintf (fp,"dlff. levele la T for iuY •Jd\n w . (+feat) . feat3<) ; 

fprintf (fp,"nuaber of ext XY for neg. rot»%d\n" , (*feat) .feattl) ; 
fprintf (fp, •different levels la. X for ext XY-neg.rot 

•*d\n-.Cfeat).feat42); 
fprintf {fp, "different levels In Y for ext XY-noc.rot 

•*d\n".( # feet).feat43); 

fprintf (fp,"nuabor of ext XY for po». rot 

•*d\n", (•feet).featM); 
fprintf (fp, "different levels In X for oxt XY-poa.rot 

•*d\n".( # feat).feat*5h 
fprintf (fp, "different levels in Y for oxt XY-poa.rot 

•Sd\n" t (*feat).feat<6)i 

fprintf (fp,"nuaber of arc part* ■$d\n", (*foat) . fset65) t 

fprintf (fp,"nuabar of circle parte •|d\n", (*feet) .feat66) ; 

fprintf (fp,"nuaber of different X-levsls -M\ri", (*feet) .feat67) i 

fprlatf (fp,*auaber of different Y-levels -Jd\n" , ( # f eat) . f eat68) t 



fprintf (fp.'eua of equare weights 

•Xd\n" , ( # feat) .sua_sqr_*ct) ;•/ 

fprintf ( fp , "\nj&a\n" , ( # feat) .IDf eat ) t 
for (l-e;l<HUM_PBAT;l**) 

fprintf ( f p . "»d" . (*f eat ) - f eet[l] ) ; 
If ((1--28) || (1--48)) fprintf (fp.*\n"); 
} 

fcloee (fp)s 

} 
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'Inelude "aaln.h- 

lnt traaafora(char infile[30] .struct FEATURES *feet) 

{ 

struct POINT arr_cor[MAX NUMJJF POINTS); /• array of coordinates •/ 
struct TABLE_EXTREMONS arr_extreaoae [ MAX_NUM_OF_EXTRENOMS ] ; 
/* array of spacial points (i.e. extreauaa , "changing of pen 
position */ 

struct TABLE.BXTREMOHS arr_exc_extrna[*AX JIUN_OF_EXTRENOHS] ; 

/• array of excluded extreauaa , it is excluded froa the array 
of extreauaa by excluding close points */ 

int featO; 

int nua_of_polnts ,nua_of_extras,exc_nua_extrae; 
/••• # " 

Reading a file and calculate the nuaber of points for the syabol.and 
•tores the points read in the array : arr eor . 

/ 

nua_of_polnts"read_polats ( arr_cor,inf lie) ; 
if 7nun_of_pointe»»0) return (§); 

/ •••••• 

Calculates the extreauaa froa the array of coordinates . and stores 
It In the array : arr_extreauas . the function returns the nuaber of 
extreauaa it calculated , and it is stored in nua of extras. 

*••*••••••••••••••/ 

nua_of_axtrBs-calc_extreaoBS ( err_extreaoas ,arr_cor »nua_of_polnts) i 

Replaeea the actual coordinates of the extreauaa in arr_extreauas 
with the levela of these coordinates by doing quantisation, (there 
are 16 levela) 

# / 

. con?21ovels ( arr_ex treaoas ,nua_of_extras. If eatO) ; 

/ * 
Excludes cloaa points in the extreauaa array and stores the reaainlng 
extreauaa in arr_exe_extras , it returna the nuaber of extreauaa left 
after excluding." " 

/ 

exc_nua_extras*analyae_extreaoaa (arr_cor,arr_extreaoae, 
arr_exe extras • nue_of _extrae ) ; 



ealeulatea the faaturea of the ayabol , and atoraa it la the structure 
variable feat. 

V 

calc faaturea 

( t (*f eat) ,nua_of .points , err_exc_extrns , exc_aua_oxtras . f eatO) ; 
return (nua of_polnts); 

} 



SUBSTITUTE SHEET 



WO 94/09447 



PCI7US92/08703 



67 - 



^include "Bain.h" 

/ 

a procedure to update the ainlaua and aaxiaua Halts of a syabol , 

according to features of entered symbol (I.e. : feat) 



void calc Halts (struct FEATURES *oin feat. struct FEATURES *aax feat, 
struct FEATURES feat) 

{ 

lnt 1; 

for <i-©;l<NUM FEAT;!** ) 
{ 

If ( (feat.feat[l])<( ( # Bln f eat) . f eat[l ] ) ) 

( ( # aln_feat) .feat[l])-7feat.feat[l]) ; 
If ( (feat.feat[l])>< ( # aax feat ) . f eat[l] ) ) 

( (*aajc feat) .feat[l]) -Treat. feat[l]) ; 

) 



Saves ainlaua and aaxiaua features of a syabol do disk (I.e. spacaa 
files) 

/ 

void save_aln_aax (struct FEATURES aln_feat, 
struct FEATURES aax'feat) 

< 

FILE # fp; 

char space[8] ,Cteap[8] ; 
lnt teap; 

strcpy (space ♦ "space" ) ; 
teap-aln^feat . feat[3] ; 
ltoa ( teap. Cteap. 10) ; 
street (space. Cteap) ; 

If ( ( f p- f open ( apace . " ab* • ) ) ! -NULL ) 

{ 

fvrlte (4«ln_feat,elseof <aln_faat) ,l.fp) ; 
fvrlta (laax~feat,slsaof (aax_feat) , l.fp) ; 
felose ( fp) ;~ 

> 

) 
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#include <stdio.h> 

^include <stdlib.h> 

^include <math.h> 

# include <conio .h> 

# include < values . h> 

^include <cneo.h> 

^include <string.h> 

finclude <process .h> 

#define GRID 15 

#define MAX NUM OF POINTS 1000 
#define MAX~NUM~OF~STROKES 64 
^define MAX NUM~OF~EXTREMOMS 32 
#define NUM~FEAT 53 
#define NUM~SYMBOLS 72 
#deflne DIVISER 6 
#define TRUE 1 
#define FALSE 0 



typedef int boolean; 



struct TABLE_STROKES_NEW { 
unsigned strknua 
int delta_x 
int delta_y 
unsigned lenght 
unsigned pen_status 
int rotation 

); 



struct POINT { 

unsigned x_cor : 10; 

unsigned y_cor : 10; 

unsigned pen status : 4; 

}; 

struct TABLE_EXTREM0MS { 



unsigned p_ndx 
unsigned x_cor 
unsigned y_cor 
unsigned pen_sts 
unsigned dir 
unsigned in_rot 
unsigned out_rot 
unsigned susp 
unsigned reserve 
}; 



10; 
10; 
10; 

1; 

4 

1 
4 



struct FEATURES { 

char IDfeat[ll]; / # Id feature for naae •/ 
unsigned int feat[NUM FEAT]; 
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feet[6] 

feat[l] 
feat[2] 

feat[3] 
feat[4] 

feat[5] 

feat[6] 
feat[7] 
feat[8] 

feet[9] 

feet(l«] 

feat[ll] 

feat[12] 
faat[l3] 
feet[l4] 

feat[15] 
feat[l6] 
feat[l7] 

faat[l6] 
f"tU91 
faat[29] 

feat[21] 
feat[22] 
feat[23] 

feat[24] 
feat[25] 
feet[26] 
feat[27] 

feat[28] 
feat[29] 
f«»t[30) 

faat[31] 
f«t[32] 
f«»t[33] 
f«t[3*) 

f«*t[35] 
f«t[36] 
f«mt[37] 
f««t[38) 

feat(39] 
feat[40] 
feat[4l] 
feat[42] 



relativa also of ayabol 32*dlv_round(Xwldth, Ywldth) 
nuaber of polnta " 
nuaber of atrokea 
nuaber of spaces 

nuaber of different levels In X for and of space 
nuaber of different lavels in Y for end of apace 

nuaber of Ext X In nog. rot 
different levels In X for alnX 
different levala In Y for alnX 

nuaber of Ext In X poe.rot 
different levela In X for aaxX 
different levela In Y for aaxX 

nuaber of Bat In Y net;, rot 
different levela In X for Bin? 
different levela In Y for alnY 

nuaber of Ext In Y poa.rot 
different levela In X for aaxY 
different levala In Y for aaxY 

nuaber of BxtXY for neff. rot 
different levela In X for feat 4l 
different levela in Y for feat 41 

nuaber of BxtXY for pos. rot 
different levela in X for feat 44 
different levela In Y for feat 44 

nuaber of arc parts 
nuaber of circle parts 
nuaber of X-levele In ayabol 
nuaber of Y-levela la ayabol 

nuaber of linear atrokea (in_rot- -9) 
nuaber of pea. rot* atrokea Tln_rot»*l) 
nuaber of nee* rot. atrokea (ln~rot»-7) 

nuaber of linear atrokea where dlr-6,1 

nuaber of linear atrokea where dir-2,3 

nuaber of lineer atrokea where dlr*4,5 

nuaber of linear atrokea where dir-6,7 

nuaber of atrokes where out_rot«6.1 

nuaber of atrokes where out_rot*2,3 

nuaber of atrokes where out_rot«4.5 

nuaber of atrokes where out_rot»6,7 

nuaber of apacea where q a 0,l 

nuaber of apacea where q"2,3 

nuaber of apacea where q*4,5 

nuaber of apacea where q«6,7 
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feat[43] • nuaber of •paces where out_rot-e.l 

feat[44] - nuaber of spaces where out_rof2,3 

feat[*»5] • nuaber of spaces where out~rot»<».5 

feat[46] • nuaber of spaces where out~rot-6,7 

feae[47] 0 nuaber of aln X. 

feat[48] * nuaber of max X. 

feat[49] • nuaber of aln Y. 

feat[58] ■ nuaber of aax Y. 

feat[51] " sua length of spaces. 
feat[52] * relative position of spaces. 
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/• MAIN FOR RECOGNITION 



V 

finclude "aain.h" 
fineiude <stdio.h> 

/• 

The program reads the file teap.ltr froa the disk . and calculates 
the aatchlng probability for every ayabol to the eyabol defined in 
the file teap.ltr , and then atorea the vector of probebilties for 
all syabola in the file data. in * 

V 

void aain() 

{ 

FILE # fp ; 

atruct FEATURES feat; 

a true t FEATURES aln feat; 

atruct FEATURES aax'feat; 

/• Vector of probabilties v for each ayabol we calculate that the 
aatchlng probability between it and the ayabol defined in 
teap.ltr •/ 
atruct { 

char nane[9]; 
lnt prob; 
} vector[NUM_SYMBOLS] ; 

lnt index; 
lnt Bpaces*G; 
lnt prob«9; 
char filenaae[ll] ; 
char Snaae[8]; 
char Cteap[10] ; 
char spacef ile[ll] ; 
char InflleCll]; 
lnt 1; 

lnt n_ap_eya-e; 

ayatea ("del feat. out"); 

for (i-e;i<-NUW SYMBOLS ) 

{ 

char SyaKaae[20]; 
char Cteap[8]; 

atrcpy (SyaNaae , "aya" ) ; 

ltoa ( i ,Cteap t 10) ; 

atrcat ( SyaNaae , Cteap ) ; 

atrcat ( SyaNaae ."."); 

atrcpy (vactor[ij .nana » SyaNaae) ; 

vector[i] .prob-0; 

} 
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strcpy (filenaae. "teap.ltr") ; 
strcpy Unfile, filenaae) ; 

/* get features of symbol In file: infile •/ 
transforn ( infile, tfeat) ; 
strcpy (feat. IDfeat, infile) ; 

spaces»feat.feat[3] ; 
ltoa (spaces , Cteap, 10) ; 
strcpy {spacefile, "space") ; 
strcat (spacefile, Cteap) ; 

Y ( (?P*f open (spacefile, "rb*")) I -NULL) 

/• for every ayebol with the saae nuaber of .paces cat alni.u. 
end aaxlaua features */ gee ainlaua 

while ((freed UUin_f eat) .aixeof (eio.feet) , 1 . fp) )>6) 
freed (4(«ex_f eat) . alzeof (aax_f eat) . 1 , fp) • 
n.8p sya**; 

/• celcualte the'probability of recognition of syabol */ 

strcpy ( feat. IDfeat , Bin feat.IDfeat) ; 
print_features (4f eat, "feat. out" ) ; 
strcpy (feat. IDfeat. infile) ; 

prob-rec ( feet ,ain_f eat ,aax feat); 

/ fill the probability in the appropriate index in the 

vector of probabilities for all the syabols V 
for (index-0;index<»NUK_SYMBOLS;index**) 

if (etrcap(ain_feat. IDfeat, vector[index].naae) 9) ( 
vector[lndex].prob • prob ; 
breek; 

} 

} 

fcloae (fp); 

) 



/• Seve vector of probabilities to disk •/ 

fp*fopen ( "data. in" ,"*♦•) ; 

for (lndex-e;lhdex<NUN SYMBOLS ; index* ♦ ) 

fprintf (fp. v '2d Id\n" .index, vector[index] .prob) ; 
fcloae (fp) ; 



exit (9); 

) 
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^include "aain.h" 

/• This procedure is to read Che points of the syobol froa a file , and 
fill it in the array of coordinates : arr cor. 

V 

int read points (struct POINT arr cor[],char *rilenaae) 
{ 

FILE # fpointer; 
unsigned int x.y.p; 

unsigned int prev_x,prev_y,prev_pen; 
unsigned int i«0,in»O; 

fpointer-fopen ( f ilenaae , "r* " ) ; 

prev_x»0; 
prev_y»0; 
prev"pen»0; 

while < (fscanf ( f pointer . "Sd %d %&* . Lx . ty , 4p) >0) 44 ( p .-o)); 
while (fscanf { f pointer, "Jd %d %d m , lx, 4y f 4p) > ©) 

{ 

if (in/DIVIS£R # DIVISER in) { 
in** ; 

arr_cor[i] .x_cor-x; 
arr_cor[i] . y_cor»y; 
arr_cor[i] . pen_status«p; 

if ( ( (abalpreO^xJ^osiprev^y-y) )>3) II (prev pen!-p)) { 

prev_x»x ; 
prev_y-y ; 
prev pen-p; 

} 

) 

else in**; 

) 

arr_cor[i] . x_eor"arr_cor[i-l] .x_cor; 
arr_cor[i] . y_cor»arr_cor[i-l] ;y_cor; 
arr_cor[i] . pen_etatus"0 ; ~ 



f close ( f pointer ) ; 
return (1); 

} 
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i\\ *tr "° J* 4nc i udas purpose procedure, which are • 

(1) def.quart : a funtion that recieves two nu.b.ra ? and return* 
the quarter of these two nu.bers in the range of 0-7 

(2) div.round : a function to calculate the round nu.ber of th* 
diviaion of two Integer nuabera ° f the 



linclude "oain.h* 

/ 

A funtion that recieves two nuabers , and returns tha »««•>.!!.**!" 
##w th;;e^two^nujbers^in the range of 0-7. racurnt th « carter of 

int def_quart (x,y) •••••••••••• 

int x; 

Int y; 
{ 

if lix>Q ) 44 (ye)) return (0) ; 
if (<x>0 ) 44 (y>0) ) return (1); 
if ((x--6) 44 {y>9) ) return (2); 
if |(x<e ) 44 (y>0) ) return (3); 
if ((x<0 ) 44 (y-ej) return (t») ; 
if ((x<0 ) 44 (y<0) ) return (5); 
if (<x--9) 44 (y<0) ) return (6); 
if <(x>0 ) 44 (y<0) ) return (7); 
return (15), 



tnfl!^! 1 !" ^° r#tur " th * pound of the diviaion of two 

integer nuaoere • 

int dlv_round (int a. int b) ** 
int i-9; 

int teapl , ceep2; 

teapl»a; 
teap2«b; 
a-abs(a) i 

if <b«6) return (MAXINT) ; 
while(a>b) 

{ 

if (b>6) a— b; 
else a*«b; 

) 

if ((a*a)>b) i** ; 

if (({te.pl>9) 44 (teap2>0)) || ((t«apl<6) 44 (teap2<e))) 
return(l); ' 
elae return <-i) ; 

> 
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#lnclude "aaln*h" 

/ 

calcualtes the space features of a syabol , (called froa 
calc_f eatures ) • 

/ 

void calc_spaee_feat (struct TABLE EXTREMOHS *xtr[],lnt extras 

struct FEATURES # feat) 

( 

int i«0; 

boolean arr_x_levels[i6] ; 
boolean arr_y_levels[l6] ; 
unsigned lnt sua*©; 

for (l-e;i<-15;i**) { arr_x_levels[i]-FALSB; 
arr y levels[l]«PALSB; 

> 

for (1-0; Kextras;!** ) 

{ 

If (extr[i].pen ats««9) 
{ 

(•feat) .feat[51]-( # faat) .feat[51)* 
( extr[ 1* 1 ] . p_ndx-extr [ 1 ] . p_ndx ) ; 
sue*-extr[i].p ndx; " 
((•faat).feat(3> + ): 
arr_x_levels(extr[ 1*1 ].x_cor] -TRUE; 
ar r_y_levela [ ex tr [ 1*1]. y~cor ] "TRUE ; 
switch <axtr[l+l] .dlr) {" 

ease 0 : ( # f eat ) . f eat[39]** ; break; 

case 1 : (*feat) . f eat[39]** : break; 

case 2 : (*feat) . f eat[40]** : break; 

case 3 * (*feat ) . feat[4©]** ; break; 

case 4 : ( •feat) . feat[4l]** ; break; 

caaa 5 : (*feat ) . f eat[4l ; break; 

caae 6 : (•feat) .feet[42]** ; break; 

case 7 ' (*feat) . feat[42J** ; break; 

default: break; 

} 

} 

) 

(•feat) *fsat[52)-div_round(8 # sua, ( # feat) *feet[l]) ; 

for (l»e;K-15;i**) { 

If (arr x - levels[l]«TRUE) ( ( ( # f eat) . feat[4] ) ♦♦) ; 

If (arr y levels[l] s -TRUB) ( ( i*T eat ) . feat[5] ) ♦♦) ; 

) 
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calcuaites the rotation features of a symbol 
calc_features ) . 



(called froe 



void calc_rot (struct TABLE EXTREMOMS extr[].int extras 
struct FEATURES # feat) 

{ 

int 1; 

for (i-l;i<«extrms:i*M ( 
switch (extr[i].in_rot) { 
case 0 : ( 
. ((•feat).feat[28])*M 
switch (extr[i].dir) { 
case 9 : ( # feat) . feat[31 ]♦♦ : break : 
case 1 : (*feat) . feat[31 i break ; 
case 2 : ( *f eat ). feat[32 ]♦♦: break ; 
case 3 : ( # f eat) . feat[32]** ; break; 
case 1 : { *f eat) . feat[33]** : break : 
case 5 : ( *feat) . feat[33]** ; break ; 
case 6 : ( *feat) . feat[ 3* ]♦♦; break ; 
case 7 : ( *feat) . feat [ 3** ]♦♦: break ; 



default: break; 



) 



} 



easel ; ( ( # feat) . f eat[29] > ; eak; 
case 7 : ( (Vest) . feat[3G] )♦♦; break; 
default : break ; 



} 



if ( (extr[i-l].pen_ets*extr[i].pen_sts)--2) 



switch (extr[l] . out^rot) { 

case 0 : ( # feat ) , feat[35>* ; break; 

(*feat).feat[35]**: break; 

( # feat).feat[36]**; break; 

( # feat).reat[36]*»; break; 

(•feat) . featC37]** : break; 

(•feat) . feat[37]** ; break; 

(•feat) .feat[38]**; break; 

(•feat) .feat[38]**; break; 



} 



case 
case 
case 
case 
case 
case 
case 
default: break: 



if ( {extr[i-l] .pen_ats*extr[i] ,pen_sts)»«l) 



switch (extr[l].out_rot) 



{ 



case 0 : ( # f eat ) . f ea t[**3 ] : 

case 1 : ( # feat ) . f ea t[*»3 ] - 

case 2 : ('feat ) . f eat[ 44 ] ; 

case 3 : <*f sat ) . f eat[ *U ] ; 

case 4 : ( # f eat ) . f eat[45]" i 
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case 5 : ( *feat) . feat[<»5]« + ; 
case 6 : { Tea t ) . f eat[t»6]*+ ; 
case 7 : ( *f eat ) . f eat[U6>* ; 



caleualtos the extreaua type features of a syabol, 
(called froa calc_f eatures ) . 



void calc_ext_typee (struct TABLE EXTREMOMS extr[] # int extras 

atruet FEATURES # feat> 

{ ? 
int i-6; 

boolean arr_x_levela[l6] ; 
boolean arr_y_levele[l6] i 

for (l-e;i<»15;i**) { 
arr x levels[l]-FALSE; 
arr^yllavela [ 1 ] -FALSE ; 



} 

for (i-l;i<extr«s;i**) 

if j(extrti].dir--3)ll((e«tr[i*l].dir*-l> 

^ ((•xtr[i].dlr«7)ll<(extrti*l].dir«5) | 

If ( (extr[l-l].pen sta*extr[i].pen ets)--2) 
< # feat).feat[6]**; 



I <extr[i*l].dir« 2))) 
<axtr[i*l].dir--6)) ) ) 



for (i-9;i<-15;i**) { 
arr x levele[i]-FALSB; 
arO"levele [ 1 ] -FALSE ; 

} 

for (l«l;l<extrejf :!♦♦) 

If ( <extr[ij.dlr— 5)ll<<extr[fl].dir«7) II <extr[i*l] .dir«6) ) ) 

extr[i].dlr--3)ll(<axtr[lU).dir«l) || (extr[l*l] .dlr— 2) ) ) 

•xtr[i].dir--5) 11 (extr[i*l].dir~l)) || 
(«xtr[l].dlr«-3) 11 <extr[l*l].dlr-- 7) ) ) 



if ( <extr[l-l],pen_ete*extr[l].peii_ata)*-2) 



{ 



arr_x_levela[extr[ 1] .x_cor] • TRUE; 
arr~y~levela[extr[i] .y~cor] • TRUE; 
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for (i-e ; i<.l5;i»*> { 

if {irr x ievela(i]--TRUE) < ( Cfaat) . feat[7] } : 
if UrOO»v«l«[i].-TRUB) (({•faat).feat[8])*») ; 



for (i-9ji<-15?i*») { 
arr x levals[i]*FALSE; 
ftrOTlevaia[i]»FALSE; 

) 

for (i«l:i<axtr»a;i*») 

if <extr[i].dir"l}44((extr[i*l].dir--3} 

(axtr[i).dir«5)44((axtr[i*l].dir« 6) | 



| <extr[i»l].dir~2))) 
{•xtrti*l].dir--7J )) ) 



if ( (axtr[i-l] .pen_ata*axtr[i] .pan_ata)--2) 



({•fHt).f«t[9]**)» 
arr_x_levels[extr[i).x_eor] - TRUE; 
arr]jrIlavala[axtr[i].y2cor] ■ TRUE; 



for (i-e:i<-15;i**) { 
arr x lev«la[i)»FALSB; 
arr"y~l«v«Xa [ i ] -FALSE ; 

} 

for (l*l;i<axtraa; i**) 

if (({extr[i].dir«7)«((«tr(i*l].dir— 5) II (axtr[i*l] .dir«6) ) ) 

extr[i].dir--i)44<(axtr[i*i].dir«3) II («*tr[l*l] .dir— 2) ) ) 

<axtr[i].dir--l) 44 (axtr[i*l) .dir--5) ) || 
{(extr[i].dir«7) 44 <axtr[i*0 .dir«3) ) ) 



if (<axtr[i-l].pan_ata+*xtr[i] .p«n_ata)*-2) 



{ 



arr_x_levela[axtr[i].x_cor] ■ TRUE; 
arr2y_lavaia[axtr[i].y~eor] ■ TRUE; 



> 



for (i»e;i<-15;i**) { 

if (arr x i«veia[i]«-TRUB) ( ( ( # faat ) . faat( 19)} ; 
if (arr~y~XavaXa[i)«TRUB) ( ( ( # faat ) . faat( XI]} ; 



for U-e;i<-X5;l**) ( 
arr x lav«Xa[i]-FALSB; 
arr"y~Xa vala [ 1 ] -FALSB ; 

> 
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for (i»i;i<axtr««;i**) 

if (((•xtr[i].dir-.5)44((«tr[i*l].dir..3) || (e«tr[fl j .dir-O) ) , 



{ 



({eaitr[i].dir..l)4t{(.xtr[i*l].dir..7) || (utr[iu] . dir-e) ) ) ) 

if ((•xtr[l-l].pen ata*extr(i] .pen ata)*-2) 
^ ffeat).feat(12]**; " ' 

for (i*esl<-15;l") { 
arr_x_leveia[i]"FALSE; 
arr_y_lev«ia[±]» FALSE; 

for (i«l ;i<extraa;i**) 

if |{Mtr[i].dir..7)t4({«tr[i*lJ.dir-.l) || (extr[iU].dir-.e) ) ) 

•*tr[i].dir«5)«((Mtr[i*i].dir«3) || ( M tr[l«l ) .dir.-*) ) ) 

(extr[i].dir— 5) t& (extr[i*l ].dir~l) ) II 
( (extr[i].dir«»7) 4& (extr[i*l ).dir»3) ) ) 

i 

if ( {•xtr[i-l].p«n_«ta*extr(i] *pen_atx)*>2) 

*"_*_levela(axtr[i).x cor] ■ TRUE; 
•»_y_l«v«Xa[tatr[i].yIcor] • TRUE; 

) 

for <i-6si<«15?i**) ( 

if (arr_x_lavela[i]« TRUE) ( ( ft aat) . f eat[13] )♦♦ ) ; 
^ if (arr_y_lavala[i]«TRUB) ( ( ( # faat) .feat[l4])**) ; * 

/ ♦ / 

for (i-6;i<-15:i**) { ' 
arr_x_levela [ i ]- FALSE ; 
arr y iav*l«[i J-FALSB ; 

} 

for ( 1-1 ;i<axtraa;i**) 

if j |(utr[l].dlr»3)U((Mtr[l*l].dlr— 5) II (axtr[i*l] ,dir--4)) ) 

^ ((•«tr[i].dir«7)WMo*tr[i*l].dlr«l) || (axtr[i*l) .dir«9) ) ) ) 

if \ (extr[l-l].p«D ata*axtr[i].pen ata)»2) 
<*feat) .faat[15]**J 

/••••••••••••••• , 

for (i-9;i<«15;i**) { 
arr_x_levela [ i ] 'FALSE ; 
arr_y_lav«Xa [ i ] -FALSE j 
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for (i-l;i<extraa;l+*) 



if 



(axtr[i].dir~ i)44< <extr[i*l] .dir~7) || <axtr[i*l] .dir«6) ) ) 
extr[i].dir—3)44({extr[i*l].dir«5) || <extr(i*l ] .dir«t») ) ) 



{ <extr[i].dir--l) &fc ( extr[i*l ] .dir--5) ) || 
^ ( (extr[l].dir«-3) 44 (extr[i*I] .dir-«7) ) ) 

if ( (oxtr[i-l].pen w «ta»extr[i].pan_ata)»«2) 

arr_x_levela(extr[i).x_cor] • TRUE; 
arr y l«vala[extr[i] .y~cor) • TRUE; 

} 

.) 

for (i-eil<-15:i**) { 

if {arr_x.l«veli[i]« TRUE) ( ( ( •feat) . faat[i6] ) ♦♦) ; 
If (arr_y_levala(i)"TRUB) ( ( ( # f eat) • feat [17] ) ♦♦ ) ; 



r 



for (i-0;i<-15:i**) { 
arr_x_levela[i]"PALSS; 
arr y~levala[i}«PALSB; 

) 

for (i«l;i<extraa;i*«) 
if (extr[i].out rot»-5) 
{ 

if ((extr[i~l].pen ata*oxtr[i}.pen •t«)-«2) 

< 

(*f«at).feet[lB]+*; 
arr_x_level«[extr[i].x_cor] • TROE; 
arr2y~laval«[axtr[i].y~cor] ■ TRUE; 

} 

) 

for U-9;i<«15:i* # ) { 

if (arr x level»(l]"TRUE) { { (*feat) . Teat[I9] >♦♦ ) ; 
if (arr"y"lavala[i]« TRUE) { ( ( # faat) .feet[2B] ) ♦♦) ; 

) 



for <i-9;±<-15?i**) ( 
arr x levala[i J-PALSE; 
arOIlaval»(i]-PALSB; 

for ;i<extr»i ;!♦♦) 

if {{•xtr[i].out_rot- -3) II <extr[i].out rot--*)) 
{ 

if ((extr[i-l].peo eta*extr[l].pen «t«)»-2) 

{ 
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(•feet).feat[21]** ; 
arr_x_levela[extr[i].x cor] • TRUE; 
arr_y_levela[extr[i].yIcor] • TRUE; 

) 

for (i-0;i<-15;i**) { 

if <arr_x_levela[i]--TRUE) ( { ( # f eat) . feat[22] ) ; 
if <arr_y_leveie[i]~ TRUE) ( ( (Teat) . feat[23] )♦♦) ; 



caleualtea tha are faaturaa of a ayabol, ' 
(callad froa calc faaturaa). 



void cale.arce (a true t TABLE EXTRBMOMS extr[],iiit extras, 
atruet FEATURES *faat) 

{ 

int i"©: 
lot j-6; 

while (Kixtras) 

{ 

if ( (extr[i].in_rot--7) 1 1 <extr[l] .in_rot« 1) ) 
((•faat) .faat[2*])**; 

while ((•xtr(l].l&_rot»7) || (utr[l].in_rot"l)) 

} 

i-e; 

while (Kextrae) 

{ 

if (extr[i].in rot«7) 
( 

J-l; 

while (extr[l).ln rot*-7) {J**;i**;) 
) elee if <extr[l].l0 rot- -l) 

{ 

J-i; 

while (extr[i].ln rofl) { J ; ; } 

} 

( (*feat> .feat[25])-( < # f eat) . feet[25])* (lot) ( J/*>) ; 
i**t 

) 
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/ • 

calculates the levels features (auaber of dlufferent levels) of a 
ayabol 

(called froa ealc_featurea ) . 

void calc_syabol_levela (struct TABLE EXTREMOWS extr[],int extraa ' 

struct FEATURES # faat) 

{ 

lnt 1*0; 

boolean arr_x_levels[ 16 ] ; 
boolean arr~y~levele[ 16] ; 

for (i-6;i<-15;i*M { 

arr x levelsf 1 ]-PALSE ; 
^ arr2yIlavala[l]«PALSB; 

for (i-9ii< -extras ;!♦♦) 
{ 

arr_x_levels[extr[i].x_cor] • TRUE; 
^ »rr_y_levele[extr[i]«y~cor] * TRUE; 

for (i-G;i<-15;i**) { 

If (arr_x levela[i]--TRUE) ( { ('feat) . f eat[26]) ♦♦) ; 
if (arr_y.levela[i]«TRUB) < ( < *f eat) . f eat[27] ) ♦♦ ) ; 

} 

/ 

calculates the nuaber of alnuauaa/aaxlauas la X and Y. 

(called froa ealc features). 

• / 

void calc nua ainaex (struct TABLE EXTRENOKS extr[],int extraa, 

struct FEATURES # faat) 

{ 

lnt 1; 

for (1*1 ;i<extrae ; i**) 
{ 

if ( (extr[l-l].pea_eta*extr[l].pen_ata)"2) 

If ( ( (extr[l].dlr--5)t4( (extr[i*l].dlr--7) || 
(extr[l*l].dlr«6) )) || 
((extr[l].dlr--3)4t((axtr[l*l).dlr« 1) | | 
. (extr[fl].dir--2))) || 

( (extr[l].dlr--5) fc4 (extr[i*l ] .dir«- 1) ) || 
((extr[l].dlr«-3) it (extr[i*l 3 -dir--7 ) ) ) 
( # faat).faat[47]**; 

If <(<extr[i].dir— 7)4i( <extr[i*l] .dir«5) II 
(axtr(t*l].dir«6))) || 

( <extr[i].dlr— 1)44( (extr[i*l].dir»»3) 1 1 
(extr[i*l].dir--2>)) || 

(<extr[i].dir~ 1) 44 (extr[l*l] ,dir«5) ) II 



SUBSTITUTE SHEET 



WO 94/09447 



PCIYUS92/08703 



- 83 - 

((extr[i].dir--7) W (extr[l*l J .dlr«»3) ) > 
(•feat) .feat[48]»*; 

If (((e*tr[i].dir"7)4M(extr[i*lj.dir«l) II 
(extr[i*X].dir--e))) || 

((extr[i].dir«5U*((extr[i*l].dir«3) I [ 
(extr[i*l).dir--4))) || 

<(extr[i].dir«5) &fc (extr[i*l].dir—l) ) || 
((extr[i].dir«7) At (extr[lU] .dlr--3) ) ) 
ff eat). feat[49]**; 




} 

) 

) 



calculates tha features of a ayabol depending on the extreauas of 
that syabol , and fills la the structure variable: feat. 



void ealc_featurea (struct FEATURES *feet,lnt points, 

struct TABLB.RXTRBH0M3 extr[], 
int extras »int featG) 
< 

lot 1; 

/• initialization •/ 

for (i-9;i<HUM_FBAT;i**) (*feat) .foat[l}-e; 

(•feat) ,feat[e] • featO ; 
(•feat) .feat[l] • points ; 
(•feat) .feat[2] - extras i 

calc_apace_feat (extr .extras* feat) ; 
calc_rot Textr. extras. feat) ; 
ealc_ext_ types ( extr t extras . feat ) ; 
calc_arcs (extr .extras, feat) : 
calc_eyabol_lovels (extr .extras , feat) ; 
calc*Qua_alnaax ( extr t extraa • f eat ) ; 
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/* This aodule is for calculating and aanlpulatlog extreauas it 
includes four procedures : ' 

(1) cale.extreauae : To find tba extreauas of tha syabol , and 
the -change in pen" points. 

(2) find_aax_extra : To find the aax/aln X-coordinate and the 
aax/aln Y-coordinate or tha syabol. 

(3) analyse.extreauas : A procedure to analyse the extreauas found 
so far, aalnly this procedure aarks close extreauas as 
suspecious extreauas. 

(4) conv21evela : Replaces the actual coordinates of the 
extreauas in arr_extresuas with the levels of these coordinates 
by doing quantisation, (there are 16 levals). •/ 

#lnclude "aaln.h" 

/•••••' 

The input of this procedure is the array of coordinates which holds 
the coordinates of the syabol . and the nuaber of these points . it 
fills the special of points (i.e. , extreauas or change in pen) in 
the array 

arr_extreauas # it returns the nuaber of special points it found. 

int celc_extreaoas (struct TABLB_EXTRENOMS arr oxtreaoes[], 

struct POIKT'arr.cortJ.int'nua^of.pointB) 



unsigned int indE; 

unsigned int ndx; 

unsigned pen_vas_up; 

int crnt_quart t prev_quert; 

int crnt_rot » prev_rot; 

int Sx.Sy.PSx.PSy.a.b; 

int f irst_point*l j 

int Pndx«9; 

unsigned Int LastNdx; 

int 1; 

lndB-0; 

ndx*Q; 

pen_wea_up*l ; 

3**0; 

Sy*0; 

PSx*9; 

PSy-0: 

a-6; b-G; 

while (ndx<nua of points) 
1 

while ((arr cor[ndx].pen status)**!) 

{ 

if (pen_wea_up"l) 
( /* beginning extreaoa */ 
if (first poinfl) 
{ 

int tSx.tSy; 
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Sx« (arr_cor[ndx*l] .x_cor-arr_cor[ndx] .x cor) ; 

SyMarr_cor[ndx*l).y_cor-arr~cor[ndx].y~cor) ; 

tSx«(arr_cor[ndx*2] .x_cor-arr_cor[ndx*l] .x cor) ; 

tSy«(arr_cor[ndx*2] .y cor-arr~cor[ndx*l] ,y~cor ) ; 

a-Sx # tSy-Sy # tSx; 

b-Sx # tSx*Sy*tSy; 

PSx»Sx; 

PSy«Sy; 

} 

else { 

/* for the previous EN0IN0 extreaoa •/ 

3x m < arr_cor [ndx] • x_cor-arr_cor[Pndx] • x_cor) ; 

Sy*.(arr_cor[ndx] .y_cor-arr_cor[Pndx] .y~cer) ; 

PSx»(arr_cor[Pndx] .x_cor-arr_cor[Pndx-l].x_cor) ; 

PSy* ( arr_cor[ Pndx] . y_cor-arr_cor[Pndx-l ] . y_cor ) ; 

a»PSx # Sy-PSy*Sx; " " v " 

b«PSx # Sx*PSy # Sy; 

arr_ex treaoaa [ indE] . p_ndx*Pndx ; 

arr_extreaoae[indE] .x_eor«arr_cor[Pndx] .x_cor ; 

arr_extreaoas[lndB]«y~cor-arr~cor[Pndx].y2cor; 

arr_extreaoaa [ indB] • pen_a ts»9 ; ~ 

arr~extreaoaa[lndB],dlr*def_quart(PSx,PSy) ; 

arr_extreaoaa[ IndB]. out rot«def quart(b»a); 

{ 

lnt PPSx.PPSy; 

PPSx-(arr_cor[Pndx-l] .x_cor-arr_eor[Pndx-2] .x_cor) ; 
PPSy- (arr_cor[Pndx-l] .y_cor-arr_cor[Pndx-2] .y~cor) ; 
a"PPSx # PSy-PPSy # PSxj " ~ ~ 

b-PPSx # PSx*PPSy # PSy; 

arr_extreaoaa[lndB] .ln_rot-def_quart(b, a) ; 



indB**; 
PSx»Sx; 
PSy»Sy; 

{ 

int tSx 4 tSy; 

Sx« ( arr_cor[ndx*l] .x_cor-arr_cor[ndx] .x_cor) ; 
Sy»(arr_cor[ndx*l ] .y_cor-arr_cor[ndx] •y.cor) ; 
tSx* ( arr_eor [ndx] • x_cor-arr_cor[ Pndx] . x_cor ) ; 
t3y« ( arr_cor[ndx] .y_cor-arr_cor[Pndx] .y~cor) ; 
a-tSx*Sy-tSy # Sx; " " 
b«tSx # Sx*tSy # Sy; 

} 

} 

crnt_quart"def_quart(Sx,Sy) ; 
crnt_rot«def_quart(b t a) ; 

arr_extreaoas[indB] *p_ndx»ndx; 
arr~extreaoas[indB] •x_cor«arr_cor[ndx] .x_cor ; 
arr~extrenoBa[indE] .y_cor«arr_cor[ndx] .y_cor; 
arr~extreaoaa[ IndB] .pen_a tfl*l ; " 
if Tfirat^poinf-1) { 

arr_extreBoaa[indE] .dir*15 • 
arr~extraaoea[indE3 . inrot-15 ; 

arr~extreBoaa[indB] .out_rot»15; 
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ndx** ; 

first point-0; 

} 

else { 

arr_extrenoms[indEj .dir»def_quart(PSx, PSy) ; 
arr_ex tremens [indE] . in_rot«0; 

^ arr_extreaoBs[indE].out_rofdef_quart(b,a) ; 

indE**; 
pen_was_up»0 ; 
} else ( 

crnt_quart-def_quart(Sx,Sy) ; 

crnt_rot«def_quart(b, a) ; 

if {( (crnt_quart!-prev quart) || 
( <crnt_rot>-4 J 44 <prev_rot<<!) ) || 
( (crnt_rot<4) 44 (prev_ro t> -4 ) ) 

44 (prev_rot!-15)) 

{ /* regular extreaoa •/ 
if ((ab8(Sx)>0) 44 (abs(Sy)>9) || (b<0)) 

if ( <ndx-l-arr_extre«OBs[indE-l].p_ndx) >0) 

arr_extreaoas[indE] .p_ndx-ndx-l ; 
err_extreaoBs[lndE] . x_cor-arr_cor[ndx-l ] .x cor; 
err_extreaoaa [ indE] . y~cor-arr2cor[ndx-l ] . y^cor ; 
arr_ex treaoas [ indE] . pen_s ts«l7 
arr_ex treaoaa [ indE] . dir»prev_quert ; 
arr_extreaoaa[ IndE] . in_rot-prev_rot ; 
arr_extreaoaa[lndE] »out_rot-crnt_rot ; 
indE**; " 

} 

} 

} 

} 

ndx** ; 

Sx*(arr_cor[ndx].x_cor-arr_cor[ndx-l] .x_cor ) ; 

Sy»(arr"cor[ndx] .y_cor-arr2cor[ndx-l] .y^cor) ; 

a«PSx*Sy-PSy*Sx; 

b«PSx # Sx*PSy*Sy ; 

PSx«Sx; 

P9y-Sy ; 

prev^quart^ernt^quart ; 
prev_rot«crnt_rot ; 
} /• and of while < arr_cor[ndx] .penatatus**! ) •/ 
if ( {pen_was_up"0 ) 44 ( arr_cor[ndx-l ] .pen_status"l ) ) 
{ /* ending extreaoa */ 
Pndx-ndx-1 ; 
pen_was_up»l ; 
LastNdx-ndx-1; 

} 

ndx**; 

} /• ndx<-NuaOfPolnts •/ 
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/• Add the last special point to toe array */ 

arr_extreaoaa[indE].p_nd*«LaetMdx; 

«rr_extreaoaa[indE].x_eer-arr_cor(LaatNdx].x cor- 

«rr_extreaoaa[indE].y_cor-arr_cor[LastKdxJ.y~corl 
arr_extreaoaa[indE].pen «t«-0; ~ 

Sx-<arr.cor[LaatNdx-l].i -C or-Brr_cor[LaatKdx-2).« cor)- 
Sy-(arr.cor[LaatNdx-l].^cor-arr.corCLaatMdx.2].K cor).' 
PSx- arr_cor[LaatNdx-2].x_cor-arr_cor[LaatHdx-3].x cor)- 
PSyMarr_cor[LaatNdx-2].y_cor-.rr_cor[LaatHdx-3].y'cor • 
arr_extreaoaa[indE].dir-def quart(Sx # Sy) ; 
a-PSx»Sy-PSy»Sx; " 

b-PSx*Sx*P$y»$y; 

arr_extreaoaa[indE].in rot-def quart(b.e); 
arr_extreaoae(indE].out_rot-157 

return (indB); 



/ * 

Y-«or«na! Ur VJh t0 "h* *** m ** /uin *^oordinat. and the aax/.m 



void find_aax_extra (i tract TABLB_8XTRBMOMS arr_extreaoaa[ ] , 

{ 

uneifaed int i«9i 



— — - - _w«« WBWWHW^J, 

int nua_of_extras,int *Xain.lat # Xaax. 
int *Yain,int # Y«ax) 



•Xain-1206; 
*Xaax*0; 
•Yain-1209; 
# Yaex«0; 

while (K-nua of axtraa) 

{ ~ ~ 



if arr_extreaoaa[i].x_cor< # Xain) •Xain-arr extreaoa.[i] .x cor: 
if arr_extreaoas(i].x_cor> # Xaax) # Xaax»arr~extreaces[i1 ,x~cor; 
if (arr_extreaoas[i].y_cor< # Yain) *Yain-arr~e*treeoesti].y~cor; 
if Urr_extreaoaeU].y_eor>»Yaax) *Yaax-arr~extreaoasri] .y'cor: 



correct dir , in_rot , out_rot for suspicious points t called froa 
analyoe_«xtreauas 

void corroct.extra (struct POINT arr cor[] # 

■truet TABLE BXTREMOHS extra[], 

•tract TABLBlBXTREHOMS arr axe axtraM , 

^ lot i.int Pi t int J) 

int Sx.Sy,PSx,PSy ; 
int ndxl,ndx2; 
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lnt a.b; 

ndxl -extra [Pi J . p_ndx; 
ndx2»extrn[i] .p ndx; 
if (Pi>0) 
{ 

if (extra[Pi-l].pen sts--0) 

{ 

PSx»arr_cor[ndxl].x_cor-arr_cor(extra[Pi-l).p ndx].x cor; 
PSy«arr_cor(ndxl J .y_cor-arr_cor[extra[Pi-l ] .p~odx] .y~cor: 

elaa { 

PSx«arr_cor[ndxl ] .x_cor-arr_cor[ndxl- 1 j . x cor; 
PSy»arr_cor[ndxl].y2cop-arr_cor[ndxl-l].y2cor; 

} alaa (PSx*0;PSy»9: > 

Sx»arr_cor[ndx2] .x_cor-arr_eor[ndxl] .x_eor; 
Sy*arr_cor[ndx2] .y_cor-arr~cor[ndxl] .y^cor; 
e«PSx*Sy-PSy*Sx; ~ 
b«PSx*Sx*P3y*Syj 

if (arr_exe_extr»[J-l] .out_rott «15) 

arr_axc_ex tr«[ J -1 ] . out_rot«daf _quar t ( b . a) ; 

PSx»Sx; 
PSy-Sy; 

err_exc_extra[ J] . dir-def _quart < PSx , PSy ) ; 

arr_exc_extrsj[ J ] . in_rot"9: 

if Tarr exc_extra[ j ] . out rot I -15) 

{ 

if (axtrm[i] .pan sts*»G) 

{ 

Sx-arr_cor[extr«[i*l].p_ndx] .x_cor-arr_cor[ndx2] .x_cor; 
Sy-arr^corCaxtrati^lJ.p^dx] .y_cor-arr2cor[adx2] .y"cor; 

else 

{ 

Sx"arr_cor[ndx2*l) .x_cor-arr_cor[ndx2] .x_cor; 
Sy-arr~cor[ndx2*l] .y2cor-arr2cor(ndx2].y~cor; 

a«PSx*Sy-PSy - Sx; 
b«PSx # Sx*PSy # 3y; 

arr axe axtra[J].out rot«def quart(b.a); 
) " 

) 

/ *• 

A procedure to analyse the extraauas found ao far , aalnly this 
procedure a arks close extreauas as suapecious extreauaa. 

* # * ••••• / 

lnt analyse extraaoas (struct POINT arr corf], 

struct TABLE EXTREMOHS extra[], 

struct TABL£~EXTRRHOMS arr_exc_extrn[ ] , 

lnt nun of axtraa) 

{ 

lnt i.J-0; 
lnt count-0; 
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boolean FirstP-TRUE; 

for (i-1 ; i<nun_of_extros ; i** ) 

if (((extrm[i].x_cor-extrm[i*l].x cor)<2 II 
(extro[i].y_cor-extrm[i+l]. y Zor)<2) 44 
(extrm[i].in_rot!-extra[i*l]7in rot) 44 
(extrm[i J .dir--extrm[i*l] .dir) 44 
(extrm[i].pen sts--l) 44 

(extrm[i-l].pen_sts!-0)) extrm[i] . susp-1 • 
^ else (extrm[i] . susp-0 ; count** ; } 

extrn[0] .susp-0; 
extrm[i] .susp-0; 
/•count** ; # / 

for (i-0;i<-num of extrmsri**) 
{ ~ ~ 

if (extrm[i] .susp»-0) { 

arr_exc_ex trm[ j ] . p_ndx«extro[ i] . p n dx • 
arr_exc_extrm[ J J -x^cor-extrmCi] .x~cor- 
arr_exc_extro[ j ] . y_cor-extrm[i ] . y~cor • 

arr_exc_extro[J].pen_sts-extrm[i]7pen sts- 
arr_exc.extra[ j ] . dir-extrm[i ] . dir; 

arr_exc_extrm[ j].in_rot -extrm[i] . in rot- 

f5 P 7" c - a ? tPB C^- out -'Ot-extpa[i].out rot; 
if ( Firs tP- -FALSE) " 

{ 

correct_extrm (arr_cor,extra, 
arr_exc_extrm, i,Pi, J) ; 
FirstP-TRUE; 

if (extro[i].pen sts--G) FirstP-TRUE • 

} 

else { 

if (FirstP) Pi-i-i; 
FirstP-FALSE; 

} 

} 
{ 

/•FILE # fp; 

fp-fopen ( "extro.out" , M ab*") ; 

for (i»0;i<-count;i**) 

{ 

fprintf (fp f "*d %d %d %d %d %d %d \n". 
arr_exc_extra[i]. p _ndx t arr exc extrm[i] .x_cor. 
arr_exc_extrm[i].y_ C or,arr exc_extrm[i] .pen sts 
arr_exc_extrm[i].dir.arr_exc extrn[i].in rot, 
arr_exe_extrm[i].out_rot) ; 

fprintf <fp, 

fclose (fp) ;•/ xn ' • 
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) 

return (count); 

} 

/ 

Replaces the actual coordinates of the extreauas In arr_extreeuas 
with the levels of these coordinates by doing quantitation .( there are 
16 levels). It also calculates featO : I.e. the relative site of 
ayabol«32*dlv round (Xwidth , Ywidth) . 



void conv21evels (struct ?ABLE_EXTREMOMS arr_extreaoas[ ] . 
lnt dub of extras ,lnt e featoJ ~ 

{ 

Int. x_width,y_wldth; 
lnt Xain ,Xaax7Yaln , Yaex ; 
lnt 1"0| 

flnd_aax_extra ( arr_extreaoas , nua_of_extras «&Xala,&Xaax, lYaln,*Yaax) ; 
x_wldth«Xaax-Xaln; ~ 
y~width- Yaax-Yaln \ 

while ( 1< s nua of extras) 

{ " " 

arr_extreaoas[l].x cor-dlv round ((arr extreaoaa[l] .x cor- 

Xain) # ORID,x_wldth); 
arr_axtreaoas[l] .y cor«dlv round ((arr extreaoaa[l] .y cor- 

Yaln)*aRID f y width); 

} 

(•feetej-dlv^roundtSO^x.width.y.wldth) ; 
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#include "aain.h" 

void print_f eatures (struct FEATURES *feat,char filenaoe[J) 



FILE # fp; 
int i; 

fp»fopen ( filename, "ab** ) ; 

/•fprintf (fp."naae of symbol -Xs\n n . ( # feat) . IDfeat ) ; 
fprintf (fp,"size of symbol -*d\n" , ( • f eat ) . f eatO ) ; 
fprintf (fp. "number of points •Zd\n" , ( *f eat ) . featl ) ; 
fprintf (fp,"nuaber of str »Jd\n" , (*feat ) . feat2) ; 
fprintf (fp. "number of spaces -*d\n" . ( # feat ) . feat3) ; 
fprintf (fp, "number of dlff. levels in X for end of 

9pace-JCd\n", (*feat) .feat**) ; 
fprintf (fp, "number of dlff. levels in Y for end of 

space-*d\n", ( # feat) . feat5); 
fprintf (fp, "number of spaces for q<^4 -|d\n" , ( *f eat ) . f eat6 ) ; 
fprintf (fp, "number of spaces for q>«tf -*d\n" , ( # f eat) . feat8) ; 
fprintf (fp, "number of spaces ro<4 

-Xd\n-. ( # feat) .feat73) : 
fprintf (fp, "number of spaces ro>«4 

•*d\n".(Veat).feat75): 

fprintf (fp, "number of linear strokes 

-Xd\n". (•feat) .featlG); 
fprintf (fp, "number of linear strokes where dlr<4 

■Id\n".( # feat).feat69): 
fprintf (fp, "number of linear strokes where dir>-4 

•*d\n".( # feat).feat7D; 

fprintf (fp, "number of strokes with pos.rot 

•*d\n", ( # feat) .featll) ; 
fprintf (fp, "number of strokes with neg.rot 

-*d\n" # («feat).featl2); 

fprintf (fp, "number of strokes ro<4 

•*d\n". ( # feat) .featl3) ; 
Tprintf (fp, "number of strokes ro>« I > 

•|d\n", Cfeat) .feat!5) ; 



fprintf (fp, "number of Ext in X neg. rot. 

•*d\n".Cfeat).featl7): 

Tprintf (fp f "diff. levels in X for oinX 

fprintf (fp/"dlff. levels in Y for ainX 

fprintf (Tp, "number of Ext in X pos . rot. 

fprlntr (rp,"difr. levels in X for aaxX 

fprintf (fp t "diff. levels in Y for aaxX 

fprintf (fp, "number of Ext in Y neg. rot. 

fprintf (fp,"diff. levels in X for ainY 

fprintf (fp,"diff. levels in Y for ainY 



»*d\n", (»feat) .featl8) ; 
■*d\n",( # feat).featl9): 

»*d\n", ( # feat) .feat20) ; 
•Xd\n" t ( # feat) .feat21) ; 
»M\d", (•feat).feat22): 

•Jd\n", f feat) .feat29) ; 
■Zd\n",( # feat) .feat30) ; 
■*d\n", ( # feat) .feat3U ; 



fprintf (fp, "number of Ext in Y pos. rot. -Xd\n" , { »f eat ) . f eat32 ) ; 
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fprintf (fp,"d±fr. levels in X for naxY vtd\n " , ( # Teat ) feat33>- 
rprlntf (fp,"dirr. levels In Y for naxY ~%d\n m . { # feat ) ! f ea t3<l ) j 

fprintf ( fp. "number of ext XY for neg. ro f?d\n" , { • f eat ) . f eat** 1 ) • 
fprintf (fp. "different levels in X for ext XY-neg.rot 

■SdU", ( # feat) ,feati!2) ; 
fprintf (fp , "different levels in Y for ext XY-neg.rot 

■Zd\n*\ ( # feat) .feat*l3) ; 

fprintf (fp,"nunber of ext XY for pos . rot 

. , "*d\n".(Veat).feattUl) : 
fprintf (fp, "different levels in X for ext XY-pos. rot 

. , •*d\n-. (*feat) .feat<»5) ; 

fprintf (fp, "different levels in Y for ext XY-pos. rot 

•Xd\n", (•feat) .feat<*6) ; 

fprintf (fp."number of arc parts -td\n* , ( *f eat) . f eat65) ; 

fprintf (fp.'nuaber of circle parta ■ld\n" , ( *f eat) . fea t66) ; 

fprintf (fp, "number of different X-levels »Xd\n" , (*feat) . feat67) ; 

fprintf (fp ( "nuober of different Y-levels **d\n" . ( # feat ) . f eat68) ; 



fprintf (fp,"sum of square weights 

-J£d\n" , (*feat) . sua_sqr_wgt) ;•/ 

fprintf (fp. "\njts\n". (*feat) .IDfeat) ; 
for (i-0;i<NUM FEAT; i** ) 
{ 

fprintf (fp."X3d w , Creat) .feat[i]) ; 
if ((1--20) || (i-.UO)) fprintf (fp.*\n") ; 
) 

fcloae (fp); 

) 
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'Include "aain.h" 

lnt transfora(cbar lnflle[30] , a truct FEATURES *feat) 

struct POINT arr_cor[HAXJ*UM_OF POINTS ] ; /• array of coordinate •/ 
struct TABLE.EXTRENOHS a?r e^tr^oestHAX NUN OF EX?« E «0«1- ' 

r position V 6Clal P ° int ' U *°* " er " u " of pen 

struct TABLE_EXTREH0MS arr_exe extraafMAX NUM OF EXTREM0MS1* 

/ array of excluded extreauas . it Is Mcludtd froa the array 
of extreeuas by excluding close points •/ 

lnt featO; 

lnt nuB_of_points,nuB_of_extraa.exc_nua_extraa; 

/••••• 

Reading a file and calculate the nuaber of points for the syabol end 
stores the point* read in the array : arr cor . 



nua_of_points*read_points (arr_cor. inf lie) ; 



irray : arr_cor 

- _ _ca 

if (nua_of_polnta--6) return (0); 

/ 

Calculates the extreauas froa the array of coordinates , and stores 
it in the array : arr_extreeuas . the function returns the nuaber of 
!JfI!! u " At "Elated , and it is stored in nua or extras 

•••• • ;•«?••••;•; , 

nua_of_extrae-calc_extreaoas <arr_extreBoas.arr_eor t nua_of_points) ; 

/ 

Replaces the actual coordinates of the extreauas in arr extreaues 
with the levels of these coordinates by doing quantisation, (thsre 
are 16 levels) 

conv21evela (arr_extreaoas .nua_of_extras .fcfeatO) ; ' 

/ 

Excludes close points in the extreauas array and stores the reaalnlnr 
extreauas in err_exc_extras , it returns the nuaber of extreauas left 
after excluding. 

••••••••••••«••••••••••• # 

exe_nun_extres»analyse_extreaoBs (arr cor.arr extreaoas, 
arr_exc_extras,nua of extras); 



/ 

calculates the features of the syabol . and stores it in the structure 
variable feat. - 



calc_features 

(4( # feat ) ,nua_of_pointa t arr_exc_extras , exc_nua_extras, f aatG) ; 

return (nua of points); 
J ~ " 
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flnclude "aaln.h* 

/ 

a function which reeieves as input Che features or a ayabol and 
aaxlouo and oiniauo features . and returns the estiaatlon of the 
probability that the entered syabol is the ayabol with the sin and 
features . 



int rec (struct FEATURES feat. struct FEATURES ain feat 
struct FEATURES sax feat) 

< 

int D; 
int theta; 
int W; 

unsigned long teap*0: 
unsigned long aua_v*6; 
int teapl; 
int N-G; 

int Rv; 
int 1; 

for (l-e;i<NUM PEAT; i*» ) 

{ 

if ((feat.feat[i]<-aax f eat . faat[i] ) 14 
(feat.faat[i]>-ain f eat. feat[i] ) ) 
theta-G; 

else { theta»l ; ) 
if { Uln_feat.feat[i]*aax_feat.feat[i])«0) 

W-0; 

0-32 # feat.feat[i]-l6; 

else 

( 

D-abs(div_round(32 # feat.feat[i] t ain_feat.feat[i]» 

aax"feat.feat[i])-l6) ; 
W-di v_ round (32 # ain_f eat. feet[i] .ain.f eat. feat[i]*aax_f eat. feat[i]); 

If ((W--16) 11 { theta-- 1)) theta-8; 

teap*»{D # theta) ; 

eua_w»«W; 

} 

teapl • ( int) lOO'teap/aua w; 

Rv - dlv_round( (NUM_FSAT-N) • ( 100- teapl ) ,NUM_FEAT) j 
return aax (G.Rv) ; 

) 
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/• Default values 
#define N_POINT 
#define DIMENSION 
Idefine N CENTER 
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APPENDIX D 

V 

500 // Number of points 

3 // Number of dinentions 

k II Number of centroids 
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#lnclude "start. h" 
^include <graphics.h> 
'Include <stdlib.h> 
llnclude <stdio.h> 
I Include <conlo . h> 
llnclude <nath.h> 

int prepare (int xc[][],int *Bl.int # o2.int •oS.int # n<l); 
void aelect_beg (int cntr[][],int ml. int a2.int a3.int a<l) 
float distance (int xc[].int cntr[]); 
float sua diet (int entr[][].int x[]); 



/• Main prograa for cluttering */ 

void aaln ( ) 
{ 

int x[N FOINT][DIMENSION],il.i2,i3.nuB points,!**: 
int center[N CENTER] [DIMENSION] ,prev cntr[ DIMENSION] , 

new_cntr(DIMENS ON]; 
int errorcode; - 
int aax_x f «ax_y, ain_x,ain_y ; 
long sua_def-0; 

float cur_dist»0.weight[N_POINT] , coaa_weight.diafe; 

/• Initialisation of coordinates of all the points •/ 

for (il-0;iX<N_P0INT:il**) 

for (12-e;i2<DIMENSION;i2*+) { 
x[il][i2]-0; 

} 

nuo_points - prepare (x, 4ain_x , Laax_x , iain_y f iiaxj ) ; 
selec t_beg ( center , ain_x , aax_x , ain_y , eax_y ) ; 



/• Calculating for every centroid it's new position according 
it's previos position and it's distance froa all the points. 

V 

for (il-0;il<N CENTER ; 11 ) { 
for (i2-0;i2<DIMENSION;i2**) { 
new cntr[12] • 0; 
prev cntr[i2]-center[il][i2]; 

) 



/ 



* Calculating the aeabership value of each point to the current 
centroid */ 

for (13-O.coaa weight-© ; 13<nue_points ; 13** ) { 

if ((cur diat-distance ( tx[13 ] [0] # icenter[il][0] ) ) <0 . GG01 ) 

weight[13] w l-9; 
else 

weight[i3><l/cur dist) /sua_dist (center, *x[i3][0]) I 
coaa weight weight[i3]**«i£ht[i3] * 
far Tl4-0;i'»<DIMENSION:i4»*| 

new cntr[i*>- weight[ 13 ] # wsl«"ht[i3 rx[i3][i* ] ; 

) 
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/• Calculation of the new position of the centroid •/ 

for (i^-0;i*l<DINENSION;H»**) { 
new_cntr[i 1 *]/-coa» weight; 
center[il][i**] - new cntr[i<l] ; 

) 

/• Checks the movement of the current centroid and stops the 
iterations if it is small (less then 3). ♦/ 

if (il«N_CENTER-l) { 

* if ( (dist*»distance(prev_cntr f icenter[il][Q]) )<3) 
break; 
dist - 0; 
il»-l; 

} 

else { 

dist*- distance(prev_cntr, lcenter[il ][0]) ; 

} 

/• Printing the points and the centroids •/ 

for (il«G;il<nua polntssll**) { 

printf ("\n Point # Jfd : "Ml); 

for (i2-9;i2<DIIIENSI0N;i2**) 
^ printf (• %5d • , x[il][i2] ) ; 

printf ("\n\n\n\n-) ; 

for (il«0;il<N CENTER ; 11 ) { 

printf ("\n CENTER I %d : ".11); 

for ( i2-G;i2<DIMENSI0H;i2**) 

printf (" %5d m ,eenter[il][i2]) ; 

) 

getch (); 
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' ^include "start. h" 98 
/• This procedure selects the initial set of centroids */ 

void select_beg(int cntr[N_C ENTER] [DIMENSION] , int Bin x 
int aax_x,int ain_y,int max_y) ~ ' 

cntr[0][0]--100; 

cntr[0][l]--100; 

cntr[0][2]-i00; 

cntr[l][0]-200; 

cntr[l][l]-0j 

cntr[l][2]-3G0; 

cntr[2][G]«0; 

cntr[2][l]--l5G; 

cntr[2][2]-i»00; 

cntr[3][0]-/|00; 
cntr[3][l]-i»O0. 
cntr[3][l]-50; 
/• cntr[0][4]-0; 
cntr[l][0]-2 # max x; 
cntr[l][l]-2 # oin"y; 
cntr[l][2]-200; 
cntr[l][3]-l©0; 
cntr[l][lf]-iO; 
cntr[2][0]-oax_x; 
cntr[2][l]-max y; 
cntr[2][2]-1007 
cntr[2][3]-lG0 5 
cntr[2][«l]-20; 
cntr[3][0]- B ±n x; 
cntr[3][l]-aax~y; 
cntr[3][2]-300T 
cntr[3][3]-10O: 
cntr[3][4]-30; 

cntr[l|][0]-min x/3; 
cntr[t»][l]-nin""y/3; 

cntr[4][2]-200T 
cntr[4][3]-i0©; 
cntr[4][i|]-0; 
cntr[5][0]-max x/3; 
cntr[5][l]-min y/3; 

cntr[5][2]-2O0T 
cntr[5][3]-l00j 

cntr[5][4]-10; 

cntr[6][0]-aax_x/3; 

cntr[6][l]-Bax"y/3; 

cntr[6][2]-10O; 

cntr[6][3]-100; 

cntr[6][M]-20; 

cntr[7][0]-nin x/3; 

cntr[7][l]-Bax_y/3; 

cntr[7][2]-300; 

cntr[7][3]-100; 

cntr[7][«»]-30: 

cntr[8][0]-«in x»2/3; 
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cntr[8][l]-Bin_y # 2/3 ; 

cntr[8][2]-200; 

cntr[8][3]-100; 

cntr[8][4]-0; 

cntr[9][9]-«>ax x # 2/3; 

cntr[9][l]-min_y»2/3; 

cntr[9][2]-2O0; 

cntr[9][3]"100; 

catr[9][4]-10; 

cntr[10][0]«nax x # 2/3; 

cntr[ 10K 1 ]*»ax~y # 2/3 ; 

cntr[10][2]-lO0T 
cnt'r[10][3]-lOO; 
cntr[lO][4]-20; 
cntr[ll][0]-Bin x # 2/3; 
cntr[ll][l]-max y # 2/3; 

cntp[ll][2]-30OT 
cntp[ll][3].i00; 

cntr[ll][4]-30; •/ 
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flnclude 
^include 
#include 
linclude 



"start .h" 
<tlae.h> 
<stdlib.h> 
<stdio.h> 



/* This procedure gets the points from file or froa other in 
device end calculates the maximums and olnlauas for each 
diaention (two dimentions in this exaaple 

int prepare(int xc(N_P0INT][DIMENSI0N] .int # ain_x f int •■ax x 
^ int *ain_y,int *aax_y) 

int countl ,count2; 
FILE • fp; 
*aax_x ■ -10000; 
*aax^y • -10000; 
•oin x • 10000; 
# «in_y - 10000; 

fp- f open ( "stroke* .s to" , "r") ; 
countl • 0; 

while ( fscanf {fp. "*6d*6dX6dX6dX6d%6d\n* ,4count2. 

4xc[countl][0),ixc[countl][l],Lxc[countl)[2], 

txc[countl][3].*xc[counti][<l]) > 0) { 
/* xc[countl][0]*-100; 

xc[countl][l]*-ie0; # / 

*aax_x • aax( # aax_x,xc[countl][G] ) ; 

*«ax"y • aax(*aax_y f xc[coun-tl][l] ) ; 

*ain_x • min( # min~x.xc[countl][0]) ; 

•■in~y • ain( # ain~y t xc[eountl][l]) ; 

countl**; ~" 

} 

f close (fp) ; 
return countl; 
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• 101 - 

linclude <aath.h> 
#include "start. h" 

/• This function gets two points and returns the sqr of the 

distance between this points #/ 

float distance (int pointl[ DIMENSION] . int P0int2 [ DIMENSION ] ) 

int i_c; 
float sua; 

for {i_c-0.su««e.0;i c<DIHENSI0N ; i c **} 

•u.~< (float) <POinti[^ c] . 

return sua ; 

} 
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finelude "start. h" . 
float di»tance(int pnt[].int cntr[J). 

/• Thi. function Mta • point and the positions or all centroids 
1 21 MEwl of .«r di.t.nc.s b.t.a.n thi. point and 

all the centroida V 

fleet eu> diet (int cntr[N .CENTER] [DIMENSION J . 
floet eu»_u« polntCDIMENSION]) 

* int ie_l.ic_2 t 
floet eur_diet; 
floet eua cur«6; 

for (ic l-9;ic 1<N CENTER ;ic_l* 4 ) { 

cur dIet.iietan«( P oint t tcntr[ic.l][9]); 

if Tcur diet <.9991} 
cur diet - 16069.; 
aue'eur l./cur.diet; 

} 

return eu«_cur; 
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1 CLAIMS 
2 

3 1. Apparatus for reading handwriting comprising: 

k a sensor for sensing features of handwriting 

5 of an individual which features are highly 

6 characteristic of the individual but which also contain 

7 information relating to symbols being written; and 

8 circuitry, which is configured for the 

9 individual, for providing a non- individual dependent 
1G output indicating the symbols being written in response 
11 to the sensed features. 

12 

13 2. Apparatus according to claim 1 and wherein 

14 said sensor and said circuitry are contained in a hand- 

15 held housing. 
16 

17 3* Apparatus according to claim 1 and also 

18 comprising a transmitter for wireless communication 

19 with a computer to which said transmitter inputs 

20 symbol data. 
21 

22 4 . Apparatus according to claim 1 and wherein 

23 said non-individual dependent output is suitable for 

24 communication with the keyboard input of a computer. 
25 

26 5- Apparatus for reading handwriting comprising: 

27 personalized hand-held apparatus for sensing 

28 acceleration during handwriting and providing an output 

29 indication of handwriting content in a- non-personalized 

30 form. 
31 

32 6. Apparatus according to claim 5 and also 

33 comprising a transmitter for wireless communication 

34 with a computer to which said transmitter inputs said 

35 output indication. 
36 

37 7- Apparatus according to claim 6 and wherein 

38 said output indication is suitable for communication 
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1 with the keyboard input of a computer. 
2 

3 8. Apparatus for reading handwriting comprising: 

4 wireless hand-held apparatus for sensing 

5 handwriting and providing an output indication of the 

6 contents thereof. 
7 

8 9* Apparatus according to claim 8 and wherein 

9 said hand-held apparatus senses acceleration during 
10 handwriting. 

11 

12 10. Apparatus according to claim 8 and wherein 

13 said apparatus is trainable. 
Ik 

15 11. Apparatus for reading handwriting comprising: 

16 

17 personally trainable hand-held apparatus for 

18 sensing motion during handwriting and providing an 

19 output indication of handwriting content. 
20 

21 12. Apparatus according to claim 11 and wherein 

22 said hand-held apparatus senses acceleration. 

23 13. Apparatus according to claim il and also 

24 comprising a transmitter for wireless communication 

25 with a computer to which said transmitter inputs 

26 symbol data . 
27 

28 14. Apparatus according to claim 11 and wherein 

29 said non-output indication is suitable for 

30 communication with the keyboard input of a computer. 
31 

32 15* Apparatus for reading handwriting in real 

33 time comprising: 

34 a hand held housing; 

35 a motion sensor disposed in said housing; 

36 a plurality of parallel recognizers disposed 

37 within said hosing and receiving signals from said 

38 motion sensor for sensing a plurality of handwriting 
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1 characteristics; and 

2 symbol recognizing means disposed in said 

3 housing receiving the outputs of said plurality of 
h parallel recognizers for providing an indication of a 
5 handwritten signal. 

6 

7 16. Apparatus according to claim 15 and wherein 

8 said motion sensor is operative to sense acceleration. 
9 

1G 17. Apparatus according to claim 15 and also 

11 comprising a transmitter for wireless communication 

12 with a computer to which said transmitter inputs 

13 symbol data. 
14 

15 18. Apparatus according to claim 1 and wherein 

16 said indication is suitable for communication with the 

17 keyboard input of a computer. 
18 

19 19- Apparatus for reading handwriting comprising: 

20 hand-held apparatus for sensing motion during 

21 handwriting and providing an output indication of 

22 handwriting content in a form corresponding to that of 

23 a conventional keyboard. 
24 

25 2G. Apparatus for reading handwriting comprising: 

26 hand-held apparatus for sensing motion during 

27 handwriting and providing an output indication of 

28 handwriting content in a RS-232 compatible form. 
29 

30 21. Audio-visual apparatus including apparatus 

31 for providing a human sensible output including 

32 information in at least one of audio and visual form 

33 and having as an input element hand-held apparatus for 

34 sensing motion during handwriting. 
35 

36 22. Audio-visual apparatus according to claim 21 

37 and wherein said hand-held apparatus comprises: 

38 a sensor for sensing features of handwriting 
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1 of an individual which features are * highly 

2 characteristic of the individual but which also contain 

3 information relating to symbols being written; and 

4 circuitry, which is configured for the 

5 individual, for providing a non-individual dependent 

6 output indicating the symbols being written in response 

7 to the sensed features. 
8 

9 23. Portable information storage and retrieval 

10 apparatus including a portable computer memory and 

11 output device and having as an input element hand-held 

12 apparatus for sensing motion during handwriting. 
13 

14 24 . Apparatus according to claim 23 and wherein 

15 said hand-held apparatus comprises: 

16 a sensor for sensing features of handwriting 

17 of an individual which features are highly 

18 characteristic of the individual but which also contain 

19 information relating to symbols being written; and 

20 circuitry, which is configured for the 

21 individual, for providing a non-individual dependent 

22 output indicating the symbols being written in response 

23 to the sensed features. 
24 

25 25. Lock apparatus including locking apparatus 

26 responsive to a predetermined electronic input and 

27 having as an input element hand-held apparatus for 

28 sensing motion during handwriting. 
29 

30 26. Apparatus according to claim 25 and wherein 

31 said hand-held apparatus comprises: 

32 a sensor for sensing features of handwriting 

33 of an individual which features are highly 

34 characteristic of the individual but which also contain 

35 information relating to symbols being written; and 

36 circuitry, which is configured for the 

37 individual, for providing a non-individual dependent 

38 output indicating the symbols being written in response 
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1 to the sensed features. 
2 

3 27. Magnetic card activated apparatus including 

4 apparatus for reading a magnetic card and having as a 

5 verification input element, hand-held apparatus for 

6 sensing motion during handwriting. 
7 

8 28. Apparatus according to claim 27 and wherein 

9 said hand-held apparatus comprises: 

10 a sensor for sensing features of handwriting 

11 of an individual which features are highly 

12 characteristic of the individual but which also contain 

13 information relating to symbols being written; and 

l*t circuitry, which is configured for the 

15 individual, for providing a non-individual dependent 

16 output indicating the symbols being written in response 

17 to the sensed features. 
18 

19 
20 
21 
22 
23 

2h 
25 

26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
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